-- Logs begin at Tue 2022-05-10 13:11:48 UTC, end at Tue 2022-05-10 14:19:04 UTC. -- May 10 13:51:01.539114 dv-cinder-840678-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 13:51:01.546441 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 13:51:01 2022] *** May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: nodename: dv-cinder-840678-6-iscsi May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: machine: x86_64 May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: clock source: unix May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: pcre jit disabled May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: detected number of CPU cores: 4 May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: current working directory: / May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: detected binary path: /usr/bin/uwsgi-core May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: your processes number limit is 47680 May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: your memory page size is 4096 bytes May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: detected max file descriptor number: 2048 May 10 13:51:01.549583 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: lock engine: pthread robust mutexes May 10 13:51:01.550563 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: thunder lock: enabled May 10 13:51:01.550563 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 13:51:01.550563 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 13:51:01.595346 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: Python main interpreter initialized at 0x55a4f37b29c0 May 10 13:51:01.595346 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: python threads support enabled May 10 13:51:01.595346 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: your server socket listen backlog is limited to 100 connections May 10 13:51:01.595346 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: your mercy for graceful operations on workers is 90 seconds May 10 13:51:01.595740 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: mapped 403077 bytes (393 KB) for 2 cores May 10 13:51:01.595819 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: *** Operational MODE: preforking *** May 10 13:51:01.596032 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: *** uWSGI is running in multiple interpreter mode *** May 10 13:51:01.596032 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: spawned uWSGI master process (pid: 102614) May 10 13:51:01.596263 dv-cinder-840678-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 13:51:01.596907 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: spawned uWSGI worker 1 (pid: 102615, cores: 1) May 10 13:51:01.597196 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: spawned uWSGI worker 2 (pid: 102616, cores: 1) May 10 13:51:01.598869 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 13:51:02.796897 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 13:51:02.809151 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 13:51:03.528370 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:51:03.528370 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: from cryptography.utils import int_from_bytes May 10 13:51:03.528759 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:51:03.528759 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: from cryptography.utils import int_from_bytes May 10 13:51:03.532518 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:51:03.532518 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: from cryptography.utils import int_from_bytes May 10 13:51:03.532850 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:51:03.532850 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: from cryptography.utils import int_from_bytes May 10 13:51:06.120378 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 13:51:06.120965 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 13:51:06.121237 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 13:51:06.121510 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 13:51:06.121770 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 13:51:06.122164 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.122496 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.122821 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.123145 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.123480 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.123796 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.123903 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 13:51:06.124401 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 13:51:06.124482 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.124482 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.124611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 13:51:06.124834 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.124980 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 13:51:06.125134 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.125233 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 13:51:06.125325 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.125627 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.125731 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-6-iscsi {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.125959 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.126060 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.126270 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.126370 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.126586 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.126692 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.126906 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.127006 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.127214 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.127311 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.127540 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.127641 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.127849 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.127947 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.128229 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.128391 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.128512 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.128819 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.128915 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.129140 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.129235 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-6-iscsi {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.129454 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.129557 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.129780 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.129881 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.130098 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.130193 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.130411 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.130516 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.130729 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.130886 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.131041 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.131139 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.131368 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.131471 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.131680 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.131881 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.132078 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-6-iscsi {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.132225 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.132436 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.132532 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.132753 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.132850 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.133069 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.133188 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.133483 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.133574 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.133846 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.133996 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.134131 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.134216 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.134423 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.134518 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.134749 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.134862 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.135063 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.135179 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.135391 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.135481 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-6-iscsi {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.135715 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.135811 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.136590 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.136706 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.136919 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.137016 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.137227 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.137348 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.137539 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.137674 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.137850 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.137996 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.138172 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.138333 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.138482 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.138670 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.138795 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.138992 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.139080 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.139331 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.139433 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.139657 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.139754 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.139981 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.140077 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.140332 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.140437 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.140584 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.140679 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.140835 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.140954 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.141158 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.141260 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.141483 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.141573 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.141795 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.141927 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.142105 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.142203 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.142416 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.142518 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.142726 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.142821 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.143035 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.143128 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.143344 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.143432 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.143653 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.143756 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.143939 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.144076 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.144217 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.144311 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.144554 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.144655 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.144886 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.144986 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.145207 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.145306 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.145518 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.145614 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.145835 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.145924 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.146152 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.146242 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.146462 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.146561 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.146775 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.146863 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.147090 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.147180 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.147408 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.147529 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.147728 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.147830 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.148049 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.148140 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.148385 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.148477 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.148699 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.148792 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.149010 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.149114 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.149332 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.149433 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.149658 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.149751 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.149968 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.150074 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.150221 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.150317 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.150517 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.150620 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.150825 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.150935 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.151384 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.151485 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.152274 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.152400 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.152601 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.152706 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.152912 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.153011 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.153218 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.153315 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.153530 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.153630 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.153841 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.153966 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.154148 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.154283 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.154456 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.154547 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.154763 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.154851 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.155069 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.155159 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.155379 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.155471 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.155686 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.155775 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.155991 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.156090 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.156338 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.156430 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.156662 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.156769 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.156971 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.157069 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.157280 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.157369 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.157585 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.157688 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.157892 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.157987 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.158210 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.158299 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.158515 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.158602 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.158825 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.158913 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.159138 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.159227 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.159444 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.159531 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.159755 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.159862 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.160072 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.160203 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.160408 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.160507 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.160716 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.160814 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.161027 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.161117 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.161330 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.161419 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.161640 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.161741 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.161962 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.162058 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.162273 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.162363 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.162583 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.162681 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.162889 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.162978 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.163195 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.163292 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.163502 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.163605 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.163810 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.163898 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.164115 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.164244 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.164450 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.164555 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.164754 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.164849 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.165072 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.165163 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.165423 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.165514 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.165730 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.165828 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.166039 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.166135 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.166348 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.166450 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.166660 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.166752 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.166976 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.167072 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.167314 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.167404 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.167629 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.167776 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.167947 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.168043 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.168285 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.168391 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.168619 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.168715 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.168953 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.169051 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.169267 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.169355 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.169583 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.169678 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.169899 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.170002 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.170232 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:51:06.170368 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.170560 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.170648 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.170878 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.171043 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.171199 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.171429 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.171527 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.171617 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.171842 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.171931 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.172163 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.172265 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.172507 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.172608 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.172832 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.172929 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.173146 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.173236 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.173468 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.173571 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.173801 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.173942 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.174126 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.174215 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.174439 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.174534 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.174766 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.174856 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.175099 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.175187 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.175418 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.175556 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.175747 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.175837 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.176067 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.176163 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.176406 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.176496 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.176728 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.176830 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.177059 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.177147 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.177398 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.177486 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.177730 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.177826 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.178059 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.178149 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.178377 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.178479 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.178697 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.178796 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.179017 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.179118 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.179332 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.179431 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.179647 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.179741 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.179961 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.180058 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.180328 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.180433 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.180647 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.180742 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.180961 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.181050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.181279 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.181382 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.181600 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.181689 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.181918 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.182025 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.182233 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.182326 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.182547 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.182637 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.182877 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.182966 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.183191 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.183281 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.183501 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.183590 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.183814 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.183903 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.184120 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.184251 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.184468 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.184557 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.184795 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.184889 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.185105 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.185200 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.185432 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.185521 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.185741 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.185850 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.186056 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.186146 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.186372 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.186460 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.186682 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.186779 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.186991 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.187086 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.187306 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.187394 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.187617 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.187714 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.187922 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.188010 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.188274 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.188380 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.188591 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.188690 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.188904 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.188994 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.189231 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.189327 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.189541 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.189631 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.189850 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.189938 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.190166 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.190262 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.190480 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.190569 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.190788 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.190876 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.191102 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.191198 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.191415 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.191511 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.191738 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.191825 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.192053 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.192142 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.192396 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.192494 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.192729 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.192820 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.193047 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.193145 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.193354 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.193442 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.193675 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.193763 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.193993 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.194159 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.194313 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.194408 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.194621 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.194710 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.194933 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.195032 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.195239 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.195328 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.195545 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.195635 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.195853 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.195950 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.196163 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.196316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.196492 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.196594 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.196800 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.196891 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.197106 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.197194 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.197412 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.197501 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.197719 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.197817 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.198046 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.198135 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.198378 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.198972 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.199249 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.199346 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.199565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.199655 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.199882 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.199971 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.200235 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.200329 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.200554 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.200667 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.200870 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.201018 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.201185 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.201359 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.201501 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.201700 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.201817 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.202051 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.202148 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.202389 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.202478 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.202710 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.202798 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.203024 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.203114 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.203338 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.203427 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.203656 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.203745 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.203972 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.204074 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.204319 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.204412 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.204636 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.204725 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.204960 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.205050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.205274 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.205363 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.205602 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.205704 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.205916 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.206008 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.206239 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.206342 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.206547 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.206645 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.206864 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.206953 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.207183 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.207271 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.207514 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.207622 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.207836 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.207931 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.208160 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.208331 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.208497 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.208598 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.208815 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.208913 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.209128 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.209217 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.209447 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.209538 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.209759 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.209856 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.210072 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.210160 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.210400 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.210527 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.210712 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.210802 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.211034 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.211129 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.211346 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.211440 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.211671 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.211765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.211982 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.212075 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.212328 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.212421 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.212639 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.212740 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.212957 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.213049 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.213290 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.213382 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.213613 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.213706 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.213922 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.214023 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.214791 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.214881 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.215116 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.215217 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.215437 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.215535 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.215751 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.215849 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.216067 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.216157 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.216400 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.216504 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.216706 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.216795 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.217022 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.217110 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.217340 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.217442 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.217652 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.217742 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.217964 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.218052 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.218272 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.218365 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.218589 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.218677 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.218899 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.218989 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.219211 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.219300 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.219519 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.219608 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.219834 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.219922 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.220155 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.220261 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.220492 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.220593 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.220816 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.220904 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.221138 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.221229 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.221455 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.221544 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.221762 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.221859 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.222082 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.222171 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.222391 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.222487 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.222696 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.222795 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.223015 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.223113 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.223337 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.223425 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.223657 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.223755 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.223982 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.224069 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.224313 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.224406 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.224640 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.224808 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.224958 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.225051 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.225293 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.225382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.225615 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.225706 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.225927 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.226051 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.226236 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.226325 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.226552 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.226649 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.226878 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.226965 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.227206 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.227296 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.227520 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.227610 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.227831 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.227919 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.228144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.228247 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.228498 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.228588 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.228819 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.228909 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.229140 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.229238 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.229453 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.229540 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.229805 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.229892 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.230112 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.230210 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.230434 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.230532 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.230753 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.230840 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.231071 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.231318 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.231416 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.231654 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.231744 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.231973 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.232062 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.232319 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.232411 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.232646 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.232736 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.232967 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.233069 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.233277 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.233373 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.233601 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.233689 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.233929 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.234035 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.234237 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.234503 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.234594 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.234845 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.234945 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.235172 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.235269 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.235502 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.235592 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.235806 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.235894 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.236131 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.236268 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.236515 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.236614 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.236858 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.236947 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.237183 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.237280 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.237492 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.237591 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.237799 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.237896 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.238108 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.238197 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.238425 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.238523 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.238731 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.238827 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.239046 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.239133 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.239356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.239445 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.239670 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.239758 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.239979 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.240080 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.240310 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.240404 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.240616 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.240705 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.240920 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.241023 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.241234 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.241329 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.241557 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.241645 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.241869 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.241966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.242191 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.242281 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.242507 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.242596 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.242840 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.242939 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.243145 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.243240 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.243460 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.243596 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.243767 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.243857 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.244076 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.244212 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.244407 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.244517 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.244719 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.244810 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.245032 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.245122 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.245359 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.245455 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.245678 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.245768 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.245993 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.246082 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.246306 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.246394 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.246617 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.246707 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.246923 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.247012 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.247234 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.247333 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.247541 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.247636 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.247860 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.247949 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.248197 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.248303 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.248504 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.248594 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.248810 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.248900 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.249126 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.249293 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.249436 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.249533 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.249741 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.249838 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.250055 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.250157 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.250361 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.250450 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.250674 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.250766 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.250979 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.251070 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.251284 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.251373 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.251592 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.251681 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.251904 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.252005 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.252235 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.252340 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.252545 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.252635 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.252856 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.252945 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.253178 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.253276 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.253494 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.253592 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.253822 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.253919 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.254130 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.254229 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.254437 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.254541 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.254744 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.254841 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.255058 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.255147 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.255373 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.255470 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.255687 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.255784 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.255991 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.256079 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.256326 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.256428 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.256637 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.256726 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.256944 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.257034 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.257250 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.257352 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.257561 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.257649 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.257867 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.257956 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.258171 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.258261 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.258476 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.258573 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.258784 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.258877 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.259093 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.259189 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.259418 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.259507 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.259731 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.259818 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.260032 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.260121 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.260364 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.260456 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.260670 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.260757 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.261505 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.261600 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.261824 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.261921 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.262138 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.262238 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.262456 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.262545 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.262772 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.262861 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.263095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.263191 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.263411 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.263500 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.263723 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.263818 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.264035 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.264137 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.264370 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.264460 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.264689 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.264778 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.265004 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.265103 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.265318 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.265407 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.265626 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.265718 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.265932 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.266022 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.266256 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.266345 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.266571 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.266659 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.266883 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.266973 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.267205 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.267294 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.267528 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.267615 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.267851 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.267939 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.268159 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.268279 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.268495 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.268599 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.268808 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.268897 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.269118 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.269206 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.269430 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.269519 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.269748 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.269838 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.270063 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.270158 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.270386 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.270487 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.270690 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.270785 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.271003 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.271099 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.271316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.271416 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.271623 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.271712 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.271933 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.272030 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.272268 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.272377 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.272579 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.272669 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.272897 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.272986 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.273206 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.273302 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.273513 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.273601 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.273824 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.273921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.274132 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.274222 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.274445 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.274535 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.274752 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.274840 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.275072 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.275185 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.275391 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.275478 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.275706 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.275796 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.276040 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.276433 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.277201 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.277296 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.277527 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.277617 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.277850 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.277941 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.278166 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.278254 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.278475 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.278572 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.278787 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.278898 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.279215 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.279302 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.279529 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.279698 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.279849 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.279938 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.280160 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.280261 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.280509 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.280612 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.280834 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.280925 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.281158 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.281247 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.281482 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.281580 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.281790 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.281879 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.282135 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.282224 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.282464 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.282562 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.282772 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.282861 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.283096 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.283193 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.283440 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.283529 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.283756 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.283845 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.284078 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.284189 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.284438 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.284558 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.284754 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.284877 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.285070 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.285193 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.285384 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.285521 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.285717 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.285847 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.286031 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.286176 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.286365 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.286486 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.286793 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.286882 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.287103 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.287201 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.287416 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.287506 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.287744 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.287832 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.288062 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.288236 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.288407 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.288507 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.288717 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.288807 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.289044 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.289134 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.289370 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.289468 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.289691 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.289780 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.290014 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.290116 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.290352 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.290516 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.290688 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.290779 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.291022 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.291112 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.291345 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.291436 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.291670 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.291761 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.291974 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.292069 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.292351 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.292456 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.292672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.292762 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.292983 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.293072 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.293292 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.293382 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.293620 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.293744 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.293928 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.294080 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.294243 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.294402 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.294559 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.294730 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.294869 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.295069 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.295159 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.295387 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.295478 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.295703 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.295790 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.296024 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.296113 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.296365 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.296469 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.296679 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.296769 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.297013 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.297104 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.297331 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.297428 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.297643 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.297731 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.297960 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.298049 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.298269 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.298364 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.298578 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.298677 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.298885 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.298982 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.299191 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.299288 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.299513 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.299612 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.299831 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.299928 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.300153 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.300310 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.300509 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.300612 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.300840 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.300994 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.301154 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.301243 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.301484 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.301582 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.301807 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.301895 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.302118 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.302206 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.302433 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.302524 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.302747 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.302843 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.303051 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.303139 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.303357 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.303454 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.303669 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.303757 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.303974 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.304070 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.304303 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.304404 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.304611 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.304700 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.304921 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.305021 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.305227 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.305354 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.305531 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.305681 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.305835 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.306009 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.306159 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.306342 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.306466 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.306659 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.306790 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.306974 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.307101 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.307294 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.307406 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.307607 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.307697 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.307967 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.308059 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.308316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.308451 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.308640 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.308777 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.308952 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.309117 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.309266 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.309458 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.309579 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.309790 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.309911 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.310121 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.310211 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.310434 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.310533 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.310759 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.310851 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.311079 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.311169 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.311395 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.311485 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.311710 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.311799 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.312029 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.312118 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.312371 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.312481 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.312689 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.312779 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.313006 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.313096 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.313318 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.313416 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.313634 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.313724 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.313949 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.314038 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.314266 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.314370 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.314606 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.314783 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.314933 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.315114 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.315258 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.315432 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.315583 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.315746 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.315908 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.316059 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.316255 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.316399 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.316582 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.316715 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.316900 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.317028 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.317225 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.317340 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.317549 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.317640 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.317875 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.317964 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.318265 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.318412 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.318590 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.318751 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.318919 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.319075 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.319255 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.319397 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.319572 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.319720 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.319892 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.320058 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.320226 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.320382 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.320546 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.320704 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.320906 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.321009 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.321224 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.321322 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.321534 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.321624 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.321850 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.321941 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.322166 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.322278 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.322480 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.322614 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.322793 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.322959 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.323108 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.323285 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.323421 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.324142 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.324313 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.324490 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.324581 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.324816 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.324906 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.325166 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.325255 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.325482 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.325572 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.325798 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.325887 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.326122 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.326212 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.326439 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.326536 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.326752 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.326856 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.327066 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.327155 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.327381 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.327469 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.327699 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.327912 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.328011 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.328256 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.328350 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.328598 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.328690 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.328930 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.329022 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.329259 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.329349 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.329579 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.329668 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.329904 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.329995 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.330233 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.330323 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.330542 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.330640 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.330849 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.330942 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.331160 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.331295 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.331470 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.331686 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.331778 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.332013 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.332111 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.332380 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.332474 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.332707 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.332797 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.333030 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.333119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.333341 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.333439 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.333664 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.333871 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.334003 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.334217 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.334336 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.334535 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.334653 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.334864 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.334961 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.335192 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.335282 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.335514 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.335604 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.335823 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.335913 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.336150 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.336303 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.336485 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.336585 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.336793 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.336883 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.337110 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.337210 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.337422 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.337662 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.337753 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.338017 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.338106 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.338328 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.338420 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.338638 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.338728 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.338942 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.339039 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.339807 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.339912 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.340115 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.340222 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.340470 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.340560 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.340779 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.340870 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.341088 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.341178 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.341397 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.341496 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.341712 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.341801 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.342018 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.342108 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.342324 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.342423 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.342633 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.342723 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.342938 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.343028 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.343252 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.343354 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.343556 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.343646 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.343867 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.343957 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.344209 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.344376 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.344511 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.344647 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.344819 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.344910 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.345131 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.345222 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.345450 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.345539 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.345765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.345856 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.346079 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.346170 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.346394 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.346485 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.346706 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.346796 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.347014 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.347104 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.347331 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.347419 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.347645 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.347747 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.347957 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.348047 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.348320 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.348413 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.348638 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.348741 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.348956 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.349171 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.349315 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.349508 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.349651 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.349837 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.349967 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.350171 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.350282 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.350503 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.350594 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.350812 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.350904 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.351122 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.351213 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.351431 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.351542 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.351756 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.351854 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.352072 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.352223 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.352412 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.352554 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.352725 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.353039 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.353127 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.353353 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.353452 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.353663 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.353754 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.353976 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.354067 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.354287 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.354403 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.354597 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.354754 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.354933 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.355051 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.355244 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.355370 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.355555 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.355706 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.355870 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.356029 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.356233 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.356374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.356561 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.356695 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.356880 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.357016 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.357197 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.357334 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.357516 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.357665 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.357828 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.357988 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.358150 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.358315 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.358464 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.358633 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.358779 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.358954 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.359097 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.359272 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.359428 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.359592 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.359751 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.359915 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.360058 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.360299 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.360503 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.360633 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.360818 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.360976 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.361142 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.361288 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.361467 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.361602 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.361780 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.361923 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.362103 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.362245 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.362428 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.362567 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.362743 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.362887 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.363066 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.363216 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.363380 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.363568 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.363713 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.363895 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.364071 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.364239 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.364500 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.364677 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.364824 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.365008 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.365121 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.365339 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.365438 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.365673 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.365775 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.365998 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.366088 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.366328 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.366416 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.366657 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.366765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.366983 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.367082 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.367292 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.367382 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.367605 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.367695 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.367910 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.367998 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.368235 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.368341 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.368545 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.368636 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.368852 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.368966 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.369163 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.369288 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.369467 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.369607 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.369780 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.369925 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.370088 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.370249 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.370462 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.370602 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.370724 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.370925 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.371023 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.371244 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.371389 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.371563 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.371700 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.371884 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.371975 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.372215 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.372308 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.372524 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.372625 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.372831 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.372921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.373145 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.373235 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.373467 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.373558 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.373783 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.373874 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.374101 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.374202 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.374415 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.374513 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.374729 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.374829 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.375045 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.375143 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.375361 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.375458 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.375679 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.375780 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.375994 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.376084 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.376332 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.376425 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.376648 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.376786 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.376961 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.377052 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.377276 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.377366 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.377591 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.377688 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.377906 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.377993 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.380581 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.380753 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.380886 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.380999 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.381114 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.381222 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.381330 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.381439 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.381560 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.381677 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.381786 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.381893 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.382000 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.382107 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.382299 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.382411 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.383030 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.383120 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.383203 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.383296 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.383388 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.383478 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.383567 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.383650 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.383741 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.383836 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.383932 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.384015 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.384096 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.384206 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.384306 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.384398 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.384488 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.384579 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.384662 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.384743 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.384834 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.384925 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.385052 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.385156 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.385248 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.385344 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.385428 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.385508 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.385591 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.385673 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.385754 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.385843 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.386546 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.386642 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.386725 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.386796 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.386863 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.386997 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.387172 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.387324 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.387536 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.387647 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.387784 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 13:51:06.387971 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.388387 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.390950 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.390950 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.390950 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.390950 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.390950 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.390950 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.390950 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.391677 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.391677 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.391677 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.391990 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.392301 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:51:06.392557 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 13:51:06.412613 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG oslo_db.sqlalchemy.engines [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:51:06.416025 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_db.sqlalchemy.engines [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:51:06.483237 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.context [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c2f3e911-f54e-4f71-9a2d-820ec19e53f3(cell1) {{(pid=102615) load_cells /opt/stack/nova/nova/context.py:464}} May 10 13:51:06.483927 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.context [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c2f3e911-f54e-4f71-9a2d-820ec19e53f3(cell1) {{(pid=102616) load_cells /opt/stack/nova/nova/context.py:464}} May 10 13:51:06.488326 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:51:06.488993 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG oslo_concurrency.lockutils [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:51:06.489915 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:51:06.490582 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG oslo_concurrency.lockutils [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:51:06.490721 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:51:06.491386 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG oslo_concurrency.lockutils [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:51:06.492678 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:51:06.493375 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG oslo_concurrency.lockutils [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:51:06.504570 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_db.sqlalchemy.engines [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:51:06.508350 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_db.sqlalchemy.engines [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:51:06.512300 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG oslo_db.sqlalchemy.engines [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:51:06.516000 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG oslo_db.sqlalchemy.engines [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:51:06.668923 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_db.sqlalchemy.engines [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:51:06.675249 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG oslo_db.sqlalchemy.engines [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:51:07.015567 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: WARNING keystonemiddleware.auth_token [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 13:51:07.021552 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: WARNING keystonemiddleware.auth_token [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 13:51:07.022921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: WARNING keystonemiddleware.auth_token [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 13:51:07.029329 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: WARNING keystonemiddleware.auth_token [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 13:51:07.373702 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: WARNING keystonemiddleware.auth_token [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 13:51:07.379907 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: WARNING keystonemiddleware.auth_token [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 13:51:07.381207 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: WARNING keystonemiddleware.auth_token [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 13:51:07.386589 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4f37b29c0 pid: 102616 (default app) May 10 13:51:07.387885 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: WARNING keystonemiddleware.auth_token [None req-fa11ef5b-3f59-43fa-96a9-3cac408a7e18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 13:51:07.388750 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:51:07.389940 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001827 May 10 13:51:07.390634 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Tue May 10 13:51:07 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:51:07.394175 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4f37b29c0 pid: 102615 (default app) May 10 13:52:24.995255 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:24.996287 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 10 13:52:24.996688 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:52:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:52:25.409530 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-5e08fe3f-a579-4701-9000-c34bbef30953 admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:25.440465 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-5e08fe3f-a579-4701-9000-c34bbef30953 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.435685 May 10 13:52:25.441216 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Tue May 10 13:52:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:52:27.709916 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:27.710912 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-f921d54c-e671-44f0-9338-b24e7d8b589b None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 10 13:52:27.711470 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:52:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:52:27.773552 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-7e3e68fd-acdb-4e8e-b8cb-ada00af4a108 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "name": "cirros256", "disk": 1}} {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:27.792431 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:52:27.792431 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: warnings.warn(msg) May 10 13:52:27.824766 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-7e3e68fd-acdb-4e8e-b8cb-ada00af4a108 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107253 May 10 13:52:27.825907 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 13:52:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:52:28.047571 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-9729a792-ca18-4e02-b289-c74401764442 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:28.049879 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:52:28.049879 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: warnings.warn(msg) May 10 13:52:28.094370 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-9729a792-ca18-4e02-b289-c74401764442 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.260699 May 10 13:52:28.095144 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Tue May 10 13:52:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:52:30.427527 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-7e3e68fd-acdb-4e8e-b8cb-ada00af4a108 admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:30.428606 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-7e3e68fd-acdb-4e8e-b8cb-ada00af4a108 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 10 13:52:30.429007 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:52:30.545590 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-e64452ad-817d-400a-aacf-6fdba1cb7101 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "swap": 0}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:30.563780 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:52:30.563780 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: warnings.warn(msg) May 10 13:52:30.584236 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-e64452ad-817d-400a-aacf-6fdba1cb7101 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148214 May 10 13:52:30.585167 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 13:52:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:52:30.597471 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-154eeee1-0b60-4b84-91da-b0dfb896debd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:30.599164 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:52:30.599164 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: warnings.warn(msg) May 10 13:52:30.630287 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-154eeee1-0b60-4b84-91da-b0dfb896debd admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036933 May 10 13:52:30.631180 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Tue May 10 13:52:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 13:52:32.988550 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-e64452ad-817d-400a-aacf-6fdba1cb7101 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:32.991284 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-e64452ad-817d-400a-aacf-6fdba1cb7101 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003505 May 10 13:52:32.993986 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:52:32 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:52:33.059492 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-461b5b10-36af-432a-b6f0-5d6b1a3f9240 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:33.079689 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-461b5b10-36af-432a-b6f0-5d6b1a3f9240 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078068 May 10 13:52:33.080525 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 13:52:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:52:33.093237 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-b2b9fb98-d0e2-4fd4-bca7-6c587647a5b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:33.118136 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-b2b9fb98-d0e2-4fd4-bca7-6c587647a5b5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028754 May 10 13:52:33.118856 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Tue May 10 13:52:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:52:35.399802 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-461b5b10-36af-432a-b6f0-5d6b1a3f9240 admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:35.401171 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-461b5b10-36af-432a-b6f0-5d6b1a3f9240 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001819 May 10 13:52:35.401610 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:52:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:52:35.462498 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-f3cb54dd-eb63-4241-b3f2-20f7a78d8e2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "name": "ds2G", "id": "d3"}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:35.480906 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-f3cb54dd-eb63-4241-b3f2-20f7a78d8e2f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072973 May 10 13:52:35.481474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 13:52:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:52:35.494291 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-8f1dd4c1-76c3-4e96-9c53-d4524b00588e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:35.516406 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-8f1dd4c1-76c3-4e96-9c53-d4524b00588e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026561 May 10 13:52:35.516920 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Tue May 10 13:52:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 13:52:37.826261 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-f3cb54dd-eb63-4241-b3f2-20f7a78d8e2f admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:37.827279 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-f3cb54dd-eb63-4241-b3f2-20f7a78d8e2f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 10 13:52:37.827686 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:52:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 13:52:37.887013 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-68f6fb57-f284-471b-b3bc-a822179b717f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "swap": 0, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:37.905670 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-68f6fb57-f284-471b-b3bc-a822179b717f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071990 May 10 13:52:37.906230 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 13:52:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:52:37.918700 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-9a3525e2-56fa-4221-9ea6-32bdd2ef16ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:37.941960 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-9a3525e2-56fa-4221-9ea6-32bdd2ef16ad admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027534 May 10 13:52:37.942716 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Tue May 10 13:52:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 13:52:40.207308 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-68f6fb57-f284-471b-b3bc-a822179b717f admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:40.208515 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-68f6fb57-f284-471b-b3bc-a822179b717f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 May 10 13:52:40.209164 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:52:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:52:40.276478 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-828892a6-c657-403a-9e89-82b2b622805f admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:40.300627 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-828892a6-c657-403a-9e89-82b2b622805f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083698 May 10 13:52:40.301434 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Tue May 10 13:52:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:52:42.592650 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-68f6fb57-f284-471b-b3bc-a822179b717f admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:42.593677 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-68f6fb57-f284-471b-b3bc-a822179b717f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 10 13:52:42.594143 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:52:42.655620 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-a0b23fd7-d627-49cb-9a7c-b2b75461a124 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:42.676432 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-a0b23fd7-d627-49cb-9a7c-b2b75461a124 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074766 May 10 13:52:42.677132 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 13:52:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 13:52:42.689854 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-2c210610-431e-4139-b2ca-6619abcd9211 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:42.714090 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-2c210610-431e-4139-b2ca-6619abcd9211 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027965 May 10 13:52:42.714663 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Tue May 10 13:52:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:52:45.259146 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-a0b23fd7-d627-49cb-9a7c-b2b75461a124 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:45.260236 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-a0b23fd7-d627-49cb-9a7c-b2b75461a124 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 May 10 13:52:45.260649 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:52:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:52:45.327808 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-e7154306-81d7-41d1-9311-3a2e33bc864a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048}} {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:45.345181 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-e7154306-81d7-41d1-9311-3a2e33bc864a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078557 May 10 13:52:45.345771 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 13:52:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:52:45.358046 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-2b510e28-8e94-4fb5-b3fc-8b1f8e3c144f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:45.381385 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-2b510e28-8e94-4fb5-b3fc-8b1f8e3c144f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027110 May 10 13:52:45.382176 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Tue May 10 13:52:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:52:47.677001 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-e7154306-81d7-41d1-9311-3a2e33bc864a admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:47.678013 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-e7154306-81d7-41d1-9311-3a2e33bc864a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 10 13:52:47.678413 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:52:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:52:47.740343 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-0382b66c-9355-47f8-b761-303e58cf5a7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "disk": 40}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:47.757888 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-0382b66c-9355-47f8-b761-303e58cf5a7a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073159 May 10 13:52:47.758434 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 13:52:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 13:52:47.770546 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-b45189da-7bce-421b-a37c-50d956b8ffa6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:47.793551 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-b45189da-7bce-421b-a37c-50d956b8ffa6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026942 May 10 13:52:47.794152 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Tue May 10 13:52:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:52:50.036856 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-0382b66c-9355-47f8-b761-303e58cf5a7a admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:50.037856 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-0382b66c-9355-47f8-b761-303e58cf5a7a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 10 13:52:50.038252 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:52:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:52:50.099133 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-d6b08fc1-51a3-45b5-bc92-d005c4e0f5ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true}} {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:50.118912 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-d6b08fc1-51a3-45b5-bc92-d005c4e0f5ac admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074234 May 10 13:52:50.119475 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 13:52:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:52:50.131413 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-dd0c4059-6a86-489e-a6aa-714654cd6b96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:50.154287 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-dd0c4059-6a86-489e-a6aa-714654cd6b96 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026629 May 10 13:52:50.154862 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Tue May 10 13:52:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:52:52.470814 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-d6b08fc1-51a3-45b5-bc92-d005c4e0f5ac admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:52.471833 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-d6b08fc1-51a3-45b5-bc92-d005c4e0f5ac admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 10 13:52:52.472263 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:52:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:52:52.535917 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-504150a9-8eec-4ce0-acf6-d14412ed65a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "name": "m1.xlarge", "id": "5"}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:52.554375 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-504150a9-8eec-4ce0-acf6-d14412ed65a6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076327 May 10 13:52:52.555065 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 13:52:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:52:52.567104 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-da9c5086-da44-46ad-ba24-21c424e466f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:52:52.589633 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-da9c5086-da44-46ad-ba24-21c424e466f1 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026216 May 10 13:52:52.590501 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Tue May 10 13:52:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:53:17.099309 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-504150a9-8eec-4ce0-acf6-d14412ed65a6 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:17.100391 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-504150a9-8eec-4ce0-acf6-d14412ed65a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 10 13:53:17.100797 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:53:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 13:53:17.158407 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-2b5c1276-c02e-4b84-9994-6845fbab4cc0 admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:17.175263 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-2b5c1276-c02e-4b84-9994-6845fbab4cc0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068744 May 10 13:53:17.175815 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Tue May 10 13:53:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:53:18.175583 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-504150a9-8eec-4ce0-acf6-d14412ed65a6 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:18.176625 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-504150a9-8eec-4ce0-acf6-d14412ed65a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 10 13:53:18.177033 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 13:53:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:53:18.375422 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-b1090934-72ed-4579-a85e-29b42e5ff83b admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:18.381019 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.wsgi [None req-b1090934-72ed-4579-a85e-29b42e5ff83b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-b1090934-72ed-4579-a85e-29b42e5ff83b admin admin] Request method failure captured: May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Accept: application/json May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Accept-Encoding: gzip, deflate May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Connection: keep-alive May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Content-Length: 0 May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Host: 10.222.0.49 May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Openstack-Api-Version: compute 2.90 May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Openstack-System-Scope: None May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: User-Agent: python-novaclient May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Auth-Token: gAAAAABiem5OdcARpyPPa93rqmNw5R2ZkKYrgrq3w4YCNBbeGKzxmr-Y0-acN4m0ErFIOsZRlT1e_ZqNnQMbacBI540BSxWNe07ZpWrHLJQhxHqWTUR2PAzj2e7YZoDfynkeZAQKU2sX8rFu6szh_Pt6Ypd7HNHuctS7EiSqDfFwnE4r80Lkfvg May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Domain-Id: None May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Domain-Name: None May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Identity-Status: Confirmed May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Is-Admin-Project: True May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Openstack-Nova-Api-Version: 2.90 May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Project-Domain-Id: default May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Project-Domain-Name: Default May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Project-Id: 71179eb4635448dd8ef63856db24457f May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Project-Name: admin May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Role: reader,member,admin May 10 13:53:18.384321 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Roles: reader,member,admin May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/71179eb4635448dd8ef63856db24457f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_71179eb4635448dd8ef63856db24457f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/71179eb4635448dd8ef63856db24457f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/71179eb4635448dd8ef63856db24457f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Tenant: admin May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Tenant-Id: 71179eb4635448dd8ef63856db24457f May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Tenant-Name: admin May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User: admin May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User-Domain-Id: default May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User-Domain-Name: Default May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User-Id: bfaa5ec258f44012bccce1e5ad959ff1 May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User-Name: admin May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: method: > May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: exception: Flavor 42 could not be found. May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: action_args: {'id': '42'} May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:53:18.386095 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:53:18.387144 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:18.388672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-b1090934-72ed-4579-a85e-29b42e5ff83b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:53:18.390013 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-b1090934-72ed-4579-a85e-29b42e5ff83b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062081 May 10 13:53:18.390013 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Tue May 10 13:53:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 13:53:18.395791 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-2a089d68-bd1f-4c2c-b722-215187a0f608 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:18.420688 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-2a089d68-bd1f-4c2c-b722-215187a0f608 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028426 May 10 13:53:18.421246 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Tue May 10 13:53:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 13:53:18.431220 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-0f0a6fcf-dffb-41bf-8d11-f993d72ef0ec admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:18.452192 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-0f0a6fcf-dffb-41bf-8d11-f993d72ef0ec admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024527 May 10 13:53:18.452768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Tue May 10 13:53:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 13:53:18.463021 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-1eda81d1-ab46-44e9-8236-28e0e518f866 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:18.468529 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.wsgi [None req-1eda81d1-ab46-44e9-8236-28e0e518f866 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-1eda81d1-ab46-44e9-8236-28e0e518f866 admin admin] Request method failure captured: May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Accept: application/json May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Accept-Encoding: gzip, deflate May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Connection: keep-alive May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Content-Length: 0 May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Host: 10.222.0.49 May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Openstack-Api-Version: compute 2.90 May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Openstack-System-Scope: None May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: User-Agent: python-novaclient May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Auth-Token: gAAAAABiem5OdcARpyPPa93rqmNw5R2ZkKYrgrq3w4YCNBbeGKzxmr-Y0-acN4m0ErFIOsZRlT1e_ZqNnQMbacBI540BSxWNe07ZpWrHLJQhxHqWTUR2PAzj2e7YZoDfynkeZAQKU2sX8rFu6szh_Pt6Ypd7HNHuctS7EiSqDfFwnE4r80Lkfvg May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Domain-Id: None May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Domain-Name: None May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Identity-Status: Confirmed May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Is-Admin-Project: True May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Openstack-Nova-Api-Version: 2.90 May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Project-Domain-Id: default May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Project-Domain-Name: Default May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Project-Id: 71179eb4635448dd8ef63856db24457f May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Project-Name: admin May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Role: reader,member,admin May 10 13:53:18.471765 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Roles: reader,member,admin May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/71179eb4635448dd8ef63856db24457f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_71179eb4635448dd8ef63856db24457f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/71179eb4635448dd8ef63856db24457f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/71179eb4635448dd8ef63856db24457f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Tenant: admin May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Tenant-Id: 71179eb4635448dd8ef63856db24457f May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Tenant-Name: admin May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User: admin May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User-Domain-Id: default May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User-Domain-Name: Default May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User-Id: bfaa5ec258f44012bccce1e5ad959ff1 May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User-Name: admin May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: method: > May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: exception: Flavor 42 could not be found. May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: action_args: {'id': '42'} May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:53:18.473379 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:53:18.474374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:18.475684 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-1eda81d1-ab46-44e9-8236-28e0e518f866 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:53:18.477032 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-1eda81d1-ab46-44e9-8236-28e0e518f866 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014371 May 10 13:53:18.477032 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Tue May 10 13:53:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 13:53:19.350798 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-0f0a6fcf-dffb-41bf-8d11-f993d72ef0ec admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:19.352357 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-0f0a6fcf-dffb-41bf-8d11-f993d72ef0ec admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 10 13:53:19.352744 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 13:53:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:53:19.549769 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-ca04e489-65af-4169-9844-191979b3385d admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:19.555561 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.wsgi [None req-ca04e489-65af-4169-9844-191979b3385d admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-ca04e489-65af-4169-9844-191979b3385d admin admin] Request method failure captured: May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Accept: application/json May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Accept-Encoding: gzip, deflate May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Connection: keep-alive May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Content-Length: 0 May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Host: 10.222.0.49 May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Openstack-Api-Version: compute 2.90 May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Openstack-System-Scope: None May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: User-Agent: python-novaclient May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Auth-Token: gAAAAABiem5PEJcS-LR6LV-z_wTiLk2TCsDAf-tqYiQATu4WXURx05cssvkHNPwODVLOS13c7qdvNezzPjBQ_Z9Ar7ixyf1nZvlgVgXJ_--MoYQPFjbbG_3c1icklpPGY-BHpLD7ETF_LHeBUWyHGZsBlD_SipfPO9LyAdGeSfJWtiYwJCvQgzk May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Domain-Id: None May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Domain-Name: None May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Identity-Status: Confirmed May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Is-Admin-Project: True May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Openstack-Nova-Api-Version: 2.90 May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Project-Domain-Id: default May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Project-Domain-Name: Default May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Project-Id: 71179eb4635448dd8ef63856db24457f May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Project-Name: admin May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Role: reader,member,admin May 10 13:53:19.557119 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Roles: reader,member,admin May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/71179eb4635448dd8ef63856db24457f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_71179eb4635448dd8ef63856db24457f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/71179eb4635448dd8ef63856db24457f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/71179eb4635448dd8ef63856db24457f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Tenant: admin May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Tenant-Id: 71179eb4635448dd8ef63856db24457f May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Tenant-Name: admin May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User: admin May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User-Domain-Id: default May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User-Domain-Name: Default May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User-Id: bfaa5ec258f44012bccce1e5ad959ff1 May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User-Name: admin May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: method: > May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: exception: Flavor 84 could not be found. May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: action_args: {'id': '84'} May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:53:19.558611 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:53:19.559565 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:19.561050 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-ca04e489-65af-4169-9844-191979b3385d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:53:19.562365 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-ca04e489-65af-4169-9844-191979b3385d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068061 May 10 13:53:19.562365 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Tue May 10 13:53:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 13:53:19.568356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-b97cdb60-48e5-445e-8cec-259a5fb47028 admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:19.582319 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-b97cdb60-48e5-445e-8cec-259a5fb47028 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017576 May 10 13:53:19.582876 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Tue May 10 13:53:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:53:19.591915 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-4d30b611-af77-4a86-a538-a83faedae347 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:19.605852 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-4d30b611-af77-4a86-a538-a83faedae347 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017385 May 10 13:53:19.606374 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Tue May 10 13:53:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:53:19.615188 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-e6f31e98-c255-4f13-8323-f7682b66640b admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:19.621097 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.wsgi [None req-e6f31e98-c255-4f13-8323-f7682b66640b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-e6f31e98-c255-4f13-8323-f7682b66640b admin admin] Request method failure captured: May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Accept: application/json May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Accept-Encoding: gzip, deflate May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Connection: keep-alive May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Content-Length: 0 May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Host: 10.222.0.49 May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Openstack-Api-Version: compute 2.90 May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Openstack-System-Scope: None May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: User-Agent: python-novaclient May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Auth-Token: gAAAAABiem5PEJcS-LR6LV-z_wTiLk2TCsDAf-tqYiQATu4WXURx05cssvkHNPwODVLOS13c7qdvNezzPjBQ_Z9Ar7ixyf1nZvlgVgXJ_--MoYQPFjbbG_3c1icklpPGY-BHpLD7ETF_LHeBUWyHGZsBlD_SipfPO9LyAdGeSfJWtiYwJCvQgzk May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Domain-Id: None May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Domain-Name: None May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Identity-Status: Confirmed May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Is-Admin-Project: True May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Openstack-Nova-Api-Version: 2.90 May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Project-Domain-Id: default May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Project-Domain-Name: Default May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Project-Id: 71179eb4635448dd8ef63856db24457f May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Project-Name: admin May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Role: reader,member,admin May 10 13:53:19.622630 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Roles: reader,member,admin May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/71179eb4635448dd8ef63856db24457f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_71179eb4635448dd8ef63856db24457f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/71179eb4635448dd8ef63856db24457f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/71179eb4635448dd8ef63856db24457f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Tenant: admin May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Tenant-Id: 71179eb4635448dd8ef63856db24457f May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Tenant-Name: admin May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User: admin May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User-Domain-Id: default May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User-Domain-Name: Default May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User-Id: bfaa5ec258f44012bccce1e5ad959ff1 May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User-Name: admin May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: method: > May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: exception: Flavor 84 could not be found. May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: action_args: {'id': '84'} May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:53:19.624201 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:53:19.625316 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:19.626672 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-e6f31e98-c255-4f13-8323-f7682b66640b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:53:19.627967 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-e6f31e98-c255-4f13-8323-f7682b66640b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012234 May 10 13:53:19.627967 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Tue May 10 13:53:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 13:53:20.513899 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-4d30b611-af77-4a86-a538-a83faedae347 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:20.514902 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-4d30b611-af77-4a86-a538-a83faedae347 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 10 13:53:20.515296 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 13:53:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:53:20.702343 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-4c6eae7d-7766-4b54-a3e4-67309dddd7d1 admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:20.707827 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.wsgi [None req-4c6eae7d-7766-4b54-a3e4-67309dddd7d1 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-4c6eae7d-7766-4b54-a3e4-67309dddd7d1 admin admin] Request method failure captured: May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Accept: application/json May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Accept-Encoding: gzip, deflate May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Connection: keep-alive May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Content-Length: 0 May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Host: 10.222.0.49 May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Openstack-Api-Version: compute 2.90 May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Openstack-System-Scope: None May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: User-Agent: python-novaclient May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Auth-Token: gAAAAABiem5QDyUyThwie0ksi4AoLKgfbEwCdTifoQOw5WqRu2n4COu4nBF3ZnmEP0KRDjpsF6LGaILMf5XFlHhsldWCiwfULa1OIslOaC0tpO5m9kK_SN34ejshV_4JCxujSWOQijpJBfjr_z0D8CN2-xyi-S87lyo7pqTh9m9tyedb_6FLDBE May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Domain-Id: None May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Domain-Name: None May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Identity-Status: Confirmed May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Is-Admin-Project: True May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Openstack-Nova-Api-Version: 2.90 May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Project-Domain-Id: default May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Project-Domain-Name: Default May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Project-Id: 71179eb4635448dd8ef63856db24457f May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Project-Name: admin May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Role: reader,member,admin May 10 13:53:20.709356 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Roles: reader,member,admin May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/71179eb4635448dd8ef63856db24457f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_71179eb4635448dd8ef63856db24457f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/71179eb4635448dd8ef63856db24457f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/71179eb4635448dd8ef63856db24457f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Tenant: admin May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Tenant-Id: 71179eb4635448dd8ef63856db24457f May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-Tenant-Name: admin May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User: admin May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User-Domain-Id: default May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User-Domain-Name: Default May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User-Id: bfaa5ec258f44012bccce1e5ad959ff1 May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: X-User-Name: admin May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: method: > May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: exception: Flavor 451 could not be found. May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: action_args: {'id': '451'} May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:53:20.710966 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:53:20.712382 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: ERROR nova.api.openstack.wsgi May 10 13:53:20.713768 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-4c6eae7d-7766-4b54-a3e4-67309dddd7d1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:53:20.715050 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-4c6eae7d-7766-4b54-a3e4-67309dddd7d1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058618 May 10 13:53:20.715050 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Tue May 10 13:53:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 13:53:20.720488 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-2dc7fbd0-78f4-4175-aff2-719a63588a82 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:20.734913 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-2dc7fbd0-78f4-4175-aff2-719a63588a82 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017977 May 10 13:53:20.735484 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Tue May 10 13:53:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:53:20.745408 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:20.759659 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018198 May 10 13:53:20.760387 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Tue May 10 13:53:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 13:53:20.769295 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-cd693cdb-611f-4d1b-bf8c-e195879a0185 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:20.774526 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.wsgi [None req-cd693cdb-611f-4d1b-bf8c-e195879a0185 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-cd693cdb-611f-4d1b-bf8c-e195879a0185 admin admin] Request method failure captured: May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Accept: application/json May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Accept-Encoding: gzip, deflate May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Connection: keep-alive May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Content-Length: 0 May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Host: 10.222.0.49 May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Openstack-Api-Version: compute 2.90 May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Openstack-System-Scope: None May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: User-Agent: python-novaclient May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Auth-Token: gAAAAABiem5QDyUyThwie0ksi4AoLKgfbEwCdTifoQOw5WqRu2n4COu4nBF3ZnmEP0KRDjpsF6LGaILMf5XFlHhsldWCiwfULa1OIslOaC0tpO5m9kK_SN34ejshV_4JCxujSWOQijpJBfjr_z0D8CN2-xyi-S87lyo7pqTh9m9tyedb_6FLDBE May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Domain-Id: None May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Domain-Name: None May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Identity-Status: Confirmed May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Is-Admin-Project: True May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Openstack-Nova-Api-Version: 2.90 May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Project-Domain-Id: default May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Project-Domain-Name: Default May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Project-Id: 71179eb4635448dd8ef63856db24457f May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Project-Name: admin May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Role: reader,member,admin May 10 13:53:20.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Roles: reader,member,admin May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/71179eb4635448dd8ef63856db24457f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_71179eb4635448dd8ef63856db24457f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/71179eb4635448dd8ef63856db24457f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/71179eb4635448dd8ef63856db24457f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Tenant: admin May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Tenant-Id: 71179eb4635448dd8ef63856db24457f May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-Tenant-Name: admin May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User: admin May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User-Domain-Id: default May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User-Domain-Name: Default May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User-Id: bfaa5ec258f44012bccce1e5ad959ff1 May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: X-User-Name: admin May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: method: > May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: exception: Flavor 451 could not be found. May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: action_args: {'id': '451'} May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:53:20.777921 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:53:20.779316 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: ERROR nova.api.openstack.wsgi May 10 13:53:20.780474 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-cd693cdb-611f-4d1b-bf8c-e195879a0185 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:53:20.781512 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-cd693cdb-611f-4d1b-bf8c-e195879a0185 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011958 May 10 13:53:20.781512 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Tue May 10 13:53:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 13:53:21.664244 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:21.665251 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 10 13:53:21.665647 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 13:53:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:53:21.852603 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-1e2cd48b-5450-4c26-8700-c50fbf2c0a96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:53:21.869622 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-1e2cd48b-5450-4c26-8700-c50fbf2c0a96 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067764 May 10 13:53:21.870183 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Tue May 10 13:53:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:53:22.747615 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:22.748702 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 10 13:53:22.749126 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 13:53:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:53:22.937512 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-7a5247b9-2274-4516-9db8-5d5bc6ec4aaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:53:22.955180 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-7a5247b9-2274-4516-9db8-5d5bc6ec4aaa admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068710 May 10 13:53:22.955724 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Tue May 10 13:53:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:53:23.845568 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:23.846580 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 10 13:53:23.846984 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 13:53:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:53:24.034184 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-bf1c6533-523e-4e25-968b-cb403621a58b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:53:24.051596 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-bf1c6533-523e-4e25-968b-cb403621a58b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067865 May 10 13:53:24.052141 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Tue May 10 13:53:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:53:24.939045 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:24.940050 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 10 13:53:24.940489 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 13:53:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:53:25.129741 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-9fa80fed-562e-4cf5-a728-4ab616158715 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:53:25.146400 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-9fa80fed-562e-4cf5-a728-4ab616158715 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067797 May 10 13:53:25.146942 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Tue May 10 13:53:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:53:26.041070 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:26.042115 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002133 May 10 13:53:26.042540 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 13:53:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:53:26.229610 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-6c12c257-b556-4ac2-96e3-c2796537c906 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:26.248841 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-6c12c257-b556-4ac2-96e3-c2796537c906 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070292 May 10 13:53:26.249378 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Tue May 10 13:53:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:54:28.272547 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:28.273561 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-da1e8bfd-4daf-4a99-ba37-2d3f87bc954d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 May 10 13:54:28.273968 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 13:54:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:28.331767 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-5cd633ae-a9f8-4155-9839-b9d52e40c5b2 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:28.351411 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-5cd633ae-a9f8-4155-9839-b9d52e40c5b2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070443 May 10 13:54:28.351945 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Tue May 10 13:54:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:54:28.374076 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-7684ec9a-686e-4d95-9c29-ed52e61d742c admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:28.381706 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-7684ec9a-686e-4d95-9c29-ed52e61d742c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012002 May 10 13:54:28.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Tue May 10 13:54:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:54:28.393699 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-36340fc9-523e-403d-a7c5-0d445872e0a5 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:28.402159 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-36340fc9-523e-403d-a7c5-0d445872e0a5 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012043 May 10 13:54:28.402675 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Tue May 10 13:54:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:54:28.414243 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-85d26f87-84a5-4057-bfa0-9a9a603f61b4 admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:28.421859 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-85d26f87-84a5-4057-bfa0-9a9a603f61b4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011855 May 10 13:54:28.422383 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Tue May 10 13:54:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:54:28.433322 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-224e7245-e3bc-4b39-85b5-5e697494f80f admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:28.440596 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-224e7245-e3bc-4b39-85b5-5e697494f80f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010779 May 10 13:54:28.441108 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Tue May 10 13:54:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:57:49.799595 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-85d26f87-84a5-4057-bfa0-9a9a603f61b4 admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:57:49.800675 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-85d26f87-84a5-4057-bfa0-9a9a603f61b4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 May 10 13:57:49.801081 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 13:57:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:57:50.065881 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-e8a63816-5cc4-43cd-a129-82dbd887c668 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:57:50.067058 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:57:50.067058 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: warnings.warn(msg) May 10 13:57:50.068291 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-e8a63816-5cc4-43cd-a129-82dbd887c668 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:57:50.068745 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-e8a63816-5cc4-43cd-a129-82dbd887c668 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:57:50.069536 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-e8a63816-5cc4-43cd-a129-82dbd887c668 admin admin] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:57:50.069970 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-e8a63816-5cc4-43cd-a129-82dbd887c668 admin admin] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:57:50.103002 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-e8a63816-5cc4-43cd-a129-82dbd887c668 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.147702 May 10 13:57:50.103543 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Tue May 10 13:57:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:57:51.049651 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-85d26f87-84a5-4057-bfa0-9a9a603f61b4 admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:57:51.050663 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-85d26f87-84a5-4057-bfa0-9a9a603f61b4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 May 10 13:57:51.051065 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 13:57:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:57:51.239323 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-645cae7b-d315-49f9-88bf-6675b35b5e63 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:57:51.240601 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:57:51.240601 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: warnings.warn(msg) May 10 13:57:51.241805 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-645cae7b-d315-49f9-88bf-6675b35b5e63 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:57:51.242245 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-645cae7b-d315-49f9-88bf-6675b35b5e63 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:57:51.243040 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-645cae7b-d315-49f9-88bf-6675b35b5e63 admin admin] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:57:51.243466 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-645cae7b-d315-49f9-88bf-6675b35b5e63 admin admin] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:57:51.262353 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-645cae7b-d315-49f9-88bf-6675b35b5e63 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073276 May 10 13:57:51.262832 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Tue May 10 13:57:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:58:02.579686 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-85d26f87-84a5-4057-bfa0-9a9a603f61b4 admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:58:02.580712 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-85d26f87-84a5-4057-bfa0-9a9a603f61b4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 May 10 13:58:02.581113 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 13:58:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 13:58:02.772401 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-2fe95273-41e1-4d86-b4af-a2f81c47abd3 admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:58:02.773597 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:58:02.773597 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: warnings.warn(msg) May 10 13:58:02.774774 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-2fe95273-41e1-4d86-b4af-a2f81c47abd3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:58:02.775511 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-2fe95273-41e1-4d86-b4af-a2f81c47abd3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:58:02.776337 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-2fe95273-41e1-4d86-b4af-a2f81c47abd3 admin admin] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:58:02.776763 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-2fe95273-41e1-4d86-b4af-a2f81c47abd3 admin admin] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:58:02.801536 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-2fe95273-41e1-4d86-b4af-a2f81c47abd3 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082085 May 10 13:58:02.802007 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Tue May 10 13:58:02 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:58:03.711763 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: DEBUG nova.api.openstack.wsgi [None req-85d26f87-84a5-4057-bfa0-9a9a603f61b4 admin admin] Calling method '>' {{(pid=102615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:58:03.712798 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: INFO nova.api.openstack.requestlog [None req-85d26f87-84a5-4057-bfa0-9a9a603f61b4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 10 13:58:03.713198 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: [pid: 102615|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 13:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:58:03.901478 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG nova.api.openstack.wsgi [None req-e65a5e31-afae-4b67-9ae0-e326e23b47fa admin admin] Calling method '>' {{(pid=102616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:58:03.902669 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:58:03.902669 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: warnings.warn(msg) May 10 13:58:03.903841 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-e65a5e31-afae-4b67-9ae0-e326e23b47fa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:58:03.904340 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-e65a5e31-afae-4b67-9ae0-e326e23b47fa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:58:03.905120 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-e65a5e31-afae-4b67-9ae0-e326e23b47fa admin admin] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:58:03.905548 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: DEBUG oslo_concurrency.lockutils [None req-e65a5e31-afae-4b67-9ae0-e326e23b47fa admin admin] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:58:03.930033 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: INFO nova.api.openstack.requestlog [None req-e65a5e31-afae-4b67-9ae0-e326e23b47fa admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079486 May 10 13:58:03.930948 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: [pid: 102616|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Tue May 10 13:58:03 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:59:04.018306 dv-cinder-840678-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 13:59:04.019173 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: Tue May 10 13:59:04 2022 - graceful shutdown triggered... May 10 13:59:04.019686 dv-cinder-840678-6-iscsi devstack@n-api.service[102615]: Gracefully killing worker 1 (pid: 102615)... May 10 13:59:04.020058 dv-cinder-840678-6-iscsi devstack@n-api.service[102616]: Gracefully killing worker 2 (pid: 102616)... May 10 13:59:05.020311 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: worker 1 buried after 1 seconds May 10 13:59:05.020311 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: worker 2 buried after 1 seconds May 10 13:59:05.020311 dv-cinder-840678-6-iscsi devstack@n-api.service[102614]: goodbye to uWSGI. May 10 13:59:05.021907 dv-cinder-840678-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 13:59:05.022468 dv-cinder-840678-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 13:59:05.025481 dv-cinder-840678-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 13:59:05.039588 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 13:59:05 2022] *** May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: nodename: dv-cinder-840678-6-iscsi May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: machine: x86_64 May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: clock source: unix May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: pcre jit disabled May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: detected number of CPU cores: 4 May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: current working directory: / May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: detected binary path: /usr/bin/uwsgi-core May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: your processes number limit is 47680 May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: your memory page size is 4096 bytes May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: detected max file descriptor number: 2048 May 10 13:59:05.055150 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: lock engine: pthread robust mutexes May 10 13:59:05.056368 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: thunder lock: enabled May 10 13:59:05.056368 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 13:59:05.056368 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 13:59:05.101175 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: Python main interpreter initialized at 0x563cc24659c0 May 10 13:59:05.101175 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: python threads support enabled May 10 13:59:05.101175 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: your server socket listen backlog is limited to 100 connections May 10 13:59:05.101175 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: your mercy for graceful operations on workers is 90 seconds May 10 13:59:05.101641 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: mapped 403077 bytes (393 KB) for 2 cores May 10 13:59:05.101641 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: *** Operational MODE: preforking *** May 10 13:59:05.101890 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: *** uWSGI is running in multiple interpreter mode *** May 10 13:59:05.101890 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: spawned uWSGI master process (pid: 117136) May 10 13:59:05.102096 dv-cinder-840678-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 13:59:05.102687 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: spawned uWSGI worker 1 (pid: 117153, cores: 1) May 10 13:59:05.103340 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: spawned uWSGI worker 2 (pid: 117154, cores: 1) May 10 13:59:05.103693 dv-cinder-840678-6-iscsi devstack@n-api.service[117136]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 13:59:06.328218 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 13:59:06.331938 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 13:59:07.147209 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:59:07.147209 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: from cryptography.utils import int_from_bytes May 10 13:59:07.147809 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:59:07.147809 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: from cryptography.utils import int_from_bytes May 10 13:59:07.163891 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:59:07.163891 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: from cryptography.utils import int_from_bytes May 10 13:59:07.164637 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:59:07.164637 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: from cryptography.utils import int_from_bytes May 10 13:59:09.584878 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 13:59:09.585820 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 13:59:09.586553 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 13:59:09.587122 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 13:59:09.587579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 13:59:09.588196 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.588753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.589291 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.589818 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.590165 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.590495 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.590835 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.591174 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.591517 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.591794 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.592122 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.592485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-6-iscsi {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.592825 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.593147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.593470 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.593818 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.594671 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.595008 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.595325 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.595838 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.597226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.597226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.597226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.597626 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.597894 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.598219 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.598559 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.598885 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.599221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.599541 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.599964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-6-iscsi {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.600306 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.600422 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 13:59:09.600854 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.601747 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 13:59:09.601852 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.601852 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.602000 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 13:59:09.602081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.602169 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 13:59:09.602256 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.602329 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 13:59:09.602406 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.602485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.602793 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.602918 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.603009 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.603085 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.603259 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.603424 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.603585 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.603775 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.603937 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.604043 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.604252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.604399 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.604570 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.604893 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.605089 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.605197 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.605410 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.605522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.605714 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.605875 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.606027 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.606178 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.606328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-6-iscsi {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.606474 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.606644 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.606798 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.606945 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.607090 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.607248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.607402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.607599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.607764 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.607926 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.608079 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.608269 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.608431 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.608601 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.608756 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.608903 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.609049 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.609237 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.609399 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.609567 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.610349 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.610514 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.610671 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.610825 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.610995 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.611144 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.611298 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.611454 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.611600 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.611745 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.611901 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.612056 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.612232 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.612415 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.612568 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.612936 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.613402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.613402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.613708 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-6-iscsi {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.613869 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.614016 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.614016 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.614320 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.614320 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.614609 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.614782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.615025 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.615177 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.615344 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.615499 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.615656 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.615817 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.615979 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.616134 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.616318 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.616466 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.616613 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.616769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.616924 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.617078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.617232 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.617395 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.617612 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.617774 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.617928 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.618083 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.618241 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.618423 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.618595 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.618750 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.618913 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.619069 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.619228 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.619386 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.619550 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.619705 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.619862 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.620016 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.620248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.620413 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.620576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.620722 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.620870 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.621016 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.621161 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.621333 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.621492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.621679 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.621839 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.621996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.622143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.622301 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.622447 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.622594 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.622748 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.622904 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.623061 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.623580 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.623765 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.624853 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.625054 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.625346 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.625511 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.625672 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.625829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.625976 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.626131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.626278 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.626439 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.626586 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.626744 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.626891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.627045 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.627204 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.627359 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.627505 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.627659 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.627821 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.627969 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.628124 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.628296 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.628485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.628749 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.628942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.629093 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.629241 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.629399 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.629552 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.629713 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.629869 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.630029 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.630180 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.630336 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.630490 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.630648 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.630804 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.630972 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.631126 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.631274 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.631431 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.631592 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.631740 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.631886 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.632032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.632220 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.632376 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.632536 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.632683 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.632843 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.633008 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.633165 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.633714 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.633885 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.634041 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.634196 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.634355 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.634547 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.634709 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.634865 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.635020 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.635167 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.635339 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.635591 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.635754 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.635908 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.636055 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.636232 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.636394 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.636550 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.636706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.636854 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.637000 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.637157 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.637303 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.637470 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.637632 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.637813 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.637971 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.638126 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.638280 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.638443 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.638443 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.638730 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.638877 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.639031 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.639184 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.639341 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.639504 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.639700 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.639854 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.640018 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.640759 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.640970 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.641122 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.641269 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.641432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.641590 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.641744 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.641892 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.642038 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.642229 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.642513 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.642686 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.642837 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.642993 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.643140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.643301 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.643473 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.644006 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.644163 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.644372 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.644519 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.644694 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.644843 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.644990 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.645136 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.645281 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.645436 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.645610 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.645859 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.646013 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.646160 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.646314 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.646477 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.646624 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.646789 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.646789 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.647067 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.647214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.647369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.647525 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.647671 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.647817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.647972 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.648130 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.648323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.648472 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.648618 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.648783 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.648929 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.649089 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.649502 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.650373 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.650526 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.650760 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.650916 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.651063 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.651220 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.651377 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:59:09.651524 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.651676 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.651842 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.651989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.652142 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.652449 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.652616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.652775 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.652922 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.653075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.653233 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.653382 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.653534 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.653707 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.654245 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.654402 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.654565 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.654722 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.654870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.655026 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.655182 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.655329 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.655487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.655634 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.655781 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.655781 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.657317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.657475 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.657625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.657781 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.657944 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.658092 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.658246 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.658642 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.658807 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.659007 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.659171 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.659329 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.659489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.659647 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.659803 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.659958 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.660121 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.660400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.660558 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.660718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.660875 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.661032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.661179 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.661333 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.661488 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.661654 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.661811 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.661968 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.662115 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.662270 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.662416 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.662570 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.662725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.662887 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.663034 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.663181 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.663328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.663484 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.663639 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.663797 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.664361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.664524 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.664673 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.664822 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.665124 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.665301 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.665460 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.665608 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.665761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.665908 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.666095 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.666352 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.666512 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.666706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.666863 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.667020 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.667182 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.667329 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.667475 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.667622 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.667768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.667921 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.668080 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.668302 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.668453 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.668608 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.668763 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.668920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.669068 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.669214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.669367 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.669725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.669880 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.670038 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.670187 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.670334 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.670512 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.670672 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.670812 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.671144 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.671303 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.671451 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.671598 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.671804 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.671910 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.672014 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.672161 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.672313 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.672953 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.673046 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.673142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.673231 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.673325 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.673418 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.673505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.673590 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.673690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.673785 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.673879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.673966 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.674075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.674465 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.674574 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.674672 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.674759 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.674759 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.674914 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.674999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.675102 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.675195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.675282 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.675366 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.675450 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.675549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.675637 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.675730 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.675823 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.675917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.676003 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.676098 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.676221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.676343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.676433 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.676519 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.676605 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.676700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.676787 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.676871 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.676956 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.677039 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.677131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.677296 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.677386 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.677477 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.677571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.677657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.677755 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.677843 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.677935 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.678029 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.678122 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.678207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.678306 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.678401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.678487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.678579 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.678675 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.678769 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.678864 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.678958 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.679050 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.679143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.679228 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.679319 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.679421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.679507 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.679599 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.679685 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.679778 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.679873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.679960 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.680046 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.680139 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.680256 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.680345 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.680451 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.680546 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.680632 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.680741 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.680838 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.680937 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.681043 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.681131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.681215 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.681310 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.681396 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.681480 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.681580 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.681667 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.681759 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.681853 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.681946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.682033 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.682133 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.682228 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.682315 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.682407 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.682501 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.682597 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.682726 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.682832 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.682920 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.683005 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.683096 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.683196 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.683283 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.683375 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.683468 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.683554 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.683637 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.683735 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.683829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.683915 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.684007 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.684092 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.684201 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.684318 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.684569 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.684670 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.684768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.684863 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.684965 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.685052 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.685138 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.685222 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.685306 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.685390 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.685483 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.685577 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.685670 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.685756 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.685848 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.685933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.686017 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.686097 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.686176 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.686301 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.686441 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.686595 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.686758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.686909 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.687080 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.687221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.687400 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.687553 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.687721 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.687897 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.688062 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.688244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.688405 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.688549 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.688733 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.688862 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.689051 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.689249 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.689362 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.689554 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.689682 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.689846 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.690212 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.690498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.690816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.690918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.691138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.691227 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.691457 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.691549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.691775 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.691866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.692102 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.692203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.692470 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.692562 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.692786 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.692876 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.693105 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.693197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.693425 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.693508 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.693887 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.694208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.694618 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.694935 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.695049 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.695169 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.695346 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.695489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.695695 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.695798 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.696030 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.696125 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.696395 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.696567 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.696725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.696936 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.697041 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.697206 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.697500 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.697608 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.697718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.697839 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.698156 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.698272 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.698467 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.698612 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.698788 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.699010 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.699125 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.699273 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.699428 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.699606 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.699760 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.699939 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.700103 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.700329 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.700478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.700674 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.700788 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.701027 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.701140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.701345 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.701448 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.701660 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.701771 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.701975 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.702076 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.702288 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.702396 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.702608 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.702718 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.702923 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.703024 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.703237 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.703367 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.703584 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.703694 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.703904 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.704013 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.704252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.704356 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.704556 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.704650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.704875 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.705136 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.705287 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.705374 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.705500 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.705592 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.705814 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.705975 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.706121 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.706269 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.706423 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.706597 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.706760 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.706914 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.707056 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.708151 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.708324 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.708482 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.708634 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.708779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.708931 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.709090 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.709234 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.709379 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.709531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.709690 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.709859 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.710018 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.710171 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.710313 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.710540 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.710703 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.710703 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.711007 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.711152 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.711305 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.711450 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.711605 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.711763 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.711906 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.712061 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.712253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.712406 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.712557 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.712717 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.712860 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.713031 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.713174 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.713318 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.713467 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.713634 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.713787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.713930 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.714081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.714234 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.714385 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.714535 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.714687 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.714914 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.715062 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.715215 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.715358 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.715499 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.715654 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.715799 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.715951 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.716096 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.716267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.716361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.716361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.716544 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.716544 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.716710 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.716797 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.716883 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.716968 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.717063 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.717151 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.717245 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.717339 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.717435 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.717572 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.717688 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.717884 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.717977 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.718198 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.718321 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.718510 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.718615 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.718823 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.718917 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.719673 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.719779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.719986 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.720081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.720347 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.720455 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.720664 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.720765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.720974 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.721076 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.721286 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.721381 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.721604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.721699 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.721916 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.722020 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.722228 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.722323 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.722548 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.722645 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.722881 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.722984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.723193 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.723287 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.723506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.723609 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.723823 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.723925 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.724132 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.724248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.724467 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.724613 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.724778 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.724871 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.725095 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.725209 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.725407 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.725543 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.725719 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.725825 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.726030 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.726133 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.726341 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.726458 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.726651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.726753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.726975 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.727084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.727292 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.727409 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.727601 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.727711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.727911 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.728013 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.728248 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.728362 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.728565 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.728666 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.728876 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.728979 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.729195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.729290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.729505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.729599 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.729828 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.729931 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.730142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.730238 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.730454 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.730552 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.730766 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.730882 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.731082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.731177 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.731395 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.731487 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.731703 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.731876 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.732024 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.732106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.732365 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.732460 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.732681 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.732787 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.732991 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.733085 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.733306 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.733399 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.733619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.733729 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.733928 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.734027 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.734243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.734339 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.734572 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.734711 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.735665 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.735760 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.735867 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.735956 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.736058 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.736147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.736389 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.736485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.736700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.736805 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.737012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.737116 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.737328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.737432 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.737636 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.737735 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.737946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.738041 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.738255 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.738359 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.738572 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.738688 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.738868 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.738962 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.739180 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.739274 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.739499 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.739675 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.739807 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.739908 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.740119 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.740248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.740495 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.740601 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.740822 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.740970 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.741138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.741248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.741457 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.741564 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.741770 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.741874 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.742089 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.742183 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.742403 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.742515 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.742733 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.742846 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.743050 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.743146 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.743371 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.743467 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.743683 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.743779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.744007 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.744110 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.744351 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.744449 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.744673 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.744777 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.744988 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.745083 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.745300 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.745396 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.745634 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.745746 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.745951 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.746066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.746275 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.746387 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.746608 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.746713 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.746937 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.747051 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.747249 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.747342 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.747565 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.747657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.747883 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.748011 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.748215 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.748325 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.748532 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.748646 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.748844 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.748956 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.749160 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.749260 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.749470 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.749571 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.749787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.749902 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.750106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.750213 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.750451 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.750562 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.750771 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.750881 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.751086 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.751268 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.751405 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.751589 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.751725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.751911 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.752037 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.752269 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.752393 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.752603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.752710 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.752937 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.753033 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.753253 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.753356 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.753577 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.753681 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.753895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.753990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.754215 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.754308 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.754550 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.754644 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.754869 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.754963 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.755191 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.755285 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.755505 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.755596 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.755842 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.755955 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.756193 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.756310 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.756515 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.756609 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.756837 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.756930 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.757151 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.757252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.757578 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.757680 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.757892 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.758006 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.758209 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.758317 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.758526 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.758626 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.758837 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.758931 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.759146 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.759262 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.759460 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.759552 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.759768 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.759873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.760080 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.760203 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.760414 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.760507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.760726 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.760832 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.761042 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.761132 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.761352 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.761443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.761663 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.761827 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.761976 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.762091 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.762289 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.762411 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.762618 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.762726 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.762931 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.763135 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.763263 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.763455 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.763590 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.763775 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.763922 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.764242 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.764349 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.764447 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.764586 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.764779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.764920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.765094 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.765237 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.765414 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.765552 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.765765 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.765890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.766086 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.766190 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.766418 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.766521 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.766735 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.766827 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.767058 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.767158 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.767371 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.767464 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.767700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.767796 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.768033 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.768132 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.768385 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.768571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.768736 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.768895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.769104 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.769245 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.769434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.769590 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.769737 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.769881 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.770063 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.770213 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.770372 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.770525 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.770671 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.770824 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.771060 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.771294 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.771459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.771598 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.771744 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.771898 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.772048 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.772238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.772335 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.772422 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.772520 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.772608 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.772781 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.772893 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.773110 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.773213 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.773422 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.773516 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.773734 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.773839 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.774047 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.774400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.774609 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.774703 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.774923 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.775028 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.775233 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.775329 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.775562 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.775656 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.775883 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.775992 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.776244 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.776364 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.776564 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.776670 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.776897 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.776999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.777216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.777318 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.777531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.777640 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.777844 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.777946 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.778156 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.778266 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.778481 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.778592 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.778805 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.778966 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.779117 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.779281 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.779424 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.779573 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.779742 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.779879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.780067 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.780239 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.780413 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.780524 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.780738 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.780831 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.781061 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.781158 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.781388 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.782075 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.782259 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.782471 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.782575 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.782799 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.782912 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.783125 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.783229 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.783449 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.783544 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.783769 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.783877 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.784083 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.784203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.784425 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.784522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.784735 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.784840 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.785044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.785139 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.785355 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.785459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.785671 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.785774 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.785985 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.786087 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.786334 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.786438 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.786636 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.786732 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.786948 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.787042 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.787260 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.787353 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.787569 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.787665 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.787914 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.788015 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.788244 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.788344 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.788588 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.788701 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.788913 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.789009 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.789226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.789334 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.789549 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.789661 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.789868 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.789962 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.790198 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.790512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.790605 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.790832 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.790914 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.791219 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.791339 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.791469 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.791552 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.791787 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.791880 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.792107 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.792306 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.792457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.792591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.792776 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.792898 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.793098 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.793260 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.793419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.793522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.793744 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.793848 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.794074 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.794280 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.794385 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.794617 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.794750 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.794942 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.795048 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.795263 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.795538 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.795642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.795863 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.795959 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.796224 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.796353 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.796549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.796665 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.796864 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.796968 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.797717 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.797823 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.798048 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.798152 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.798384 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.798500 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.798706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.798818 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.799020 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.799132 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.799342 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.799457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.799659 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.799763 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.799972 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.800074 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.800328 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.800445 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.800651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.800744 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.800964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.801069 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.801299 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.801419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.801618 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.801736 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.801935 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.802160 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.802265 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.802519 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.802633 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.802840 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.802933 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.803169 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.803272 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.803490 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.803582 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.803808 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.803900 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.804121 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.804236 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.804464 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.804566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.804786 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.804956 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.805114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.805264 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.805411 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.805555 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.805699 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.805840 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.805995 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.806139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.806311 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.806454 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.806617 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.806718 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.806926 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.807078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.807223 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.807507 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.807667 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.807844 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.807986 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.808137 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.808274 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.808485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.808580 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.808799 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.808905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.809111 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.809215 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.809429 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.809533 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.809742 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.809845 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.810052 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.810156 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.810362 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.810463 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.810670 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.810773 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.811003 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.811099 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.811294 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.811411 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.811612 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.811715 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.811920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.812032 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.812252 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.812361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.812564 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.812671 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.813406 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.813502 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.813775 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.813955 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.814109 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.814309 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.814424 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.814634 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.814719 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.814969 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.815087 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.815301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.815411 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.815628 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.815745 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.815943 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.816087 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.816303 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.816442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.816607 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.816863 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.817017 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.817160 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.817301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.817521 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.817666 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.817820 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.817977 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.818128 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.818269 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.818434 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.818578 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.818751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.818920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.819051 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.819186 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.819365 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.819515 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.819662 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.819822 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.819994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.820132 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.820330 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.820445 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.820643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.820736 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.820957 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.821058 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.821275 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.821382 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.821587 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.821675 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.821899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.822004 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.822206 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.822309 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.822517 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.822610 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.822837 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.822948 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.823147 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.823250 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.823462 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.823554 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.823770 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.823869 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.824086 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.824216 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.824420 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.824514 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.824737 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.824875 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.825126 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.825237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.825452 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.825543 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.825762 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.825863 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.826078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.826171 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.826392 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.826483 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.826709 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.826817 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.827066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.827167 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.827354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.827444 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.827670 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.827776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.827996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.828086 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.828369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.828491 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.829340 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.829435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.829666 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.829781 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.829995 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.830118 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.830326 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.830463 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.830648 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.830805 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.830979 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.831124 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.831310 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.831439 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.831629 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.831756 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.831964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.832093 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.832311 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.832421 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.832653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.832750 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.833005 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.833117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.833337 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.833431 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.833657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.833753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.833970 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.834079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.834285 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.834389 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.834600 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.834705 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.834963 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.835078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.835238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.835349 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.835551 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.835643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.835864 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.835966 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.836195 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.836304 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.836522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.836624 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.836841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.836935 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.837154 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.837297 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.837466 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.837609 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.837765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.837910 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.838078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.838214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.838387 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.838531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.838691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.838832 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.838994 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.839137 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.839303 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.839461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.839608 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.839758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.839902 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.840043 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.840232 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.840344 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.840546 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.840690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.840856 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.841014 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.841166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.841341 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.841477 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.841668 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.841785 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.842005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.842161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.842319 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.842452 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.842648 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.842786 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.842970 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.843101 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.843299 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.843405 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.843619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.843789 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.843958 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.844139 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.844354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.844470 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.844693 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.844832 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.845024 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.845126 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.845336 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.845430 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.845650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.845753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.845966 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.846060 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.846285 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.846387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.846607 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.846716 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.846924 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.847091 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.847232 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.847426 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.847565 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.847714 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.847876 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.848017 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.848188 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.848329 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.848470 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.848628 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.848785 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.848933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.849073 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.849213 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.849354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.849504 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.849649 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.849771 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.849958 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.850055 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.850267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.850380 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.850576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.850673 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.850883 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.850978 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.851195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.851298 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.851511 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.851615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.851821 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.851916 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.852136 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.852319 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.852466 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.852571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.852776 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.852883 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.855277 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.855410 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.855515 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.855612 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.855698 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.855789 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.855882 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.855968 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.856058 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.856142 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.856273 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.856364 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.856450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.856533 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.856616 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.856694 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.856772 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.856863 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.856947 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.857030 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.857101 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.857183 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 13:59:09.857270 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.857270 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.857270 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.857487 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.857791 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.858110 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.858426 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.858744 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.859075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.859409 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.859748 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.860084 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.860437 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.860770 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.861096 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.861416 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.861753 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.862075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.862398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.862720 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.863041 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.863362 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.863686 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.864032 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.864393 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.864731 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.865073 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.865407 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.865765 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.866092 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.866445 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.866783 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.867115 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.867428 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.867741 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:59:09.867991 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 13:59:09.880226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_db.sqlalchemy.engines [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:59:09.891822 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_db.sqlalchemy.engines [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:59:09.944952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.context [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c2f3e911-f54e-4f71-9a2d-820ec19e53f3(cell1) {{(pid=117153) load_cells /opt/stack/nova/nova/context.py:464}} May 10 13:59:09.949360 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:09.950953 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:09.951772 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:09.953776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:09.955526 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.context [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c2f3e911-f54e-4f71-9a2d-820ec19e53f3(cell1) {{(pid=117154) load_cells /opt/stack/nova/nova/context.py:464}} May 10 13:59:09.959900 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:09.961494 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:09.962319 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:09.964305 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:09.965192 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_db.sqlalchemy.engines [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:59:09.967200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_db.sqlalchemy.engines [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:59:09.976010 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_db.sqlalchemy.engines [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:59:09.977892 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_db.sqlalchemy.engines [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:59:10.125075 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_db.sqlalchemy.engines [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:59:10.134648 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_db.sqlalchemy.engines [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:59:10.443307 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: WARNING keystonemiddleware.auth_token [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 13:59:10.450921 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: WARNING keystonemiddleware.auth_token [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 13:59:10.464686 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: WARNING keystonemiddleware.auth_token [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 13:59:10.472751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: WARNING keystonemiddleware.auth_token [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 13:59:10.796695 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: WARNING keystonemiddleware.auth_token [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 13:59:10.802997 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: WARNING keystonemiddleware.auth_token [None req-e8ec9914-fa68-485f-8f98-a77a19f8463a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 13:59:10.808948 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563cc24659c0 pid: 117153 (default app) May 10 13:59:10.826489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: WARNING keystonemiddleware.auth_token [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 13:59:10.833318 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: WARNING keystonemiddleware.auth_token [None req-65f1feca-c74c-4aff-aaf7-222bff000d7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 13:59:10.838613 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563cc24659c0 pid: 117154 (default app) May 10 13:59:52.274056 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c34fe210-160e-4a8b-b6dd-7d3c66ade917 tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Action: 'create', calling method: .version_select at 0x7f5f7d10f280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1037082340", "metadata": {"Type": "work"}}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c34fe210-160e-4a8b-b6dd-7d3c66ade917 tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Request method failure captured: May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 122 May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_XZkRrxprIVE8b9ft0yGqMr7MxhHuwgecwmFvpCs53zzFgk85geTqYYntoGgLbMIYKTVTmJ6-g14ayR1wRQoalG_ll9TJ3yV8zqF3X_DQYwPpu5Wo-GXqcr4fQ3a08JQoLldAXDDja9-Ko-tW1RRIlaI2FND4sMDFxz7fDef-gUfo May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 0f9a7482ebae4ab7a98239a604687af9 May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-VolumesNegativeTest-517407191 May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 13:59:52.292358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-VolumesNegativeTest-517407191 May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 0f9a7482ebae4ab7a98239a604687af9 May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-VolumesNegativeTest-517407191 May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-VolumesNegativeTest-517407191-project May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 3bd34a0c3ce246ee855828b8224de95e May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-VolumesNegativeTest-517407191-project May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1037082340", "metadata": {"Type": "work"}}} May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: May 10 13:59:52.293779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1037082340', 'metadata': {'Type': 'work'}}}} May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise error May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi '#$%' May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:59:52.294692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 13:59:52.297652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 13:59:52.300150 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 13:59:52.300150 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.300150 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c34fe210-160e-4a8b-b6dd-7d3c66ade917 tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:59:52.300150 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c34fe210-160e-4a8b-b6dd-7d3c66ade917 tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.072222 May 10 13:59:52.300150 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1155 bytes} [Tue May 10 13:59:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1074 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 13:59:52.527251 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bcdcc1b2-b86f-448e-b7af-19c4951a7d9a tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Action: 'create', calling method: .version_select at 0x7f5f7d136ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2058104562", "metadata": {"Type": "work"}}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bcdcc1b2-b86f-448e-b7af-19c4951a7d9a tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Request method failure captured: May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 120 May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_XZkRrxprIVE8b9ft0yGqMr7MxhHuwgecwmFvpCs53zzFgk85geTqYYntoGgLbMIYKTVTmJ6-g14ayR1wRQoalG_ll9TJ3yV8zqF3X_DQYwPpu5Wo-GXqcr4fQ3a08JQoLldAXDDja9-Ko-tW1RRIlaI2FND4sMDFxz7fDef-gUfo May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 0f9a7482ebae4ab7a98239a604687af9 May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-VolumesNegativeTest-517407191 May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 13:59:52.531200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-VolumesNegativeTest-517407191 May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 0f9a7482ebae4ab7a98239a604687af9 May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-VolumesNegativeTest-517407191 May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-VolumesNegativeTest-517407191-project May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 3bd34a0c3ce246ee855828b8224de95e May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-VolumesNegativeTest-517407191-project May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2058104562", "metadata": {"Type": "work"}}} May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: May 10 13:59:52.532546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2058104562', 'metadata': {'Type': 'work'}}}} May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise error May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi '0' May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:59:52.533301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 13:59:52.535353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 13:59:52.537049 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 13:59:52.537049 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:52.537049 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bcdcc1b2-b86f-448e-b7af-19c4951a7d9a tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:59:52.537049 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-bcdcc1b2-b86f-448e-b7af-19c4951a7d9a tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.231321 May 10 13:59:52.537049 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 1/2] 10.222.0.49 () {60 vars in 1155 bytes} [Tue May 10 13:59:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 13:59:52.543342 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f4bf7e04-7164-4871-898c-d6474ef97b5b tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Action: 'create', calling method: .version_select at 0x7f5f7cfb35e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-372593586", "metadata": {"Type": "work"}}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f4bf7e04-7164-4871-898c-d6474ef97b5b tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Request method failure captured: May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 118 May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_XZkRrxprIVE8b9ft0yGqMr7MxhHuwgecwmFvpCs53zzFgk85geTqYYntoGgLbMIYKTVTmJ6-g14ayR1wRQoalG_ll9TJ3yV8zqF3X_DQYwPpu5Wo-GXqcr4fQ3a08JQoLldAXDDja9-Ko-tW1RRIlaI2FND4sMDFxz7fDef-gUfo May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 0f9a7482ebae4ab7a98239a604687af9 May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-VolumesNegativeTest-517407191 May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 13:59:52.546081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-VolumesNegativeTest-517407191 May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 0f9a7482ebae4ab7a98239a604687af9 May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-VolumesNegativeTest-517407191 May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-VolumesNegativeTest-517407191-project May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 3bd34a0c3ce246ee855828b8224de95e May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-VolumesNegativeTest-517407191-project May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-372593586", "metadata": {"Type": "work"}}} May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: May 10 13:59:52.547377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-372593586', 'metadata': {'Type': 'work'}}}} May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise error May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi '' May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:59:52.548200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 13:59:52.549579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 13:59:52.553606 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 13:59:52.553606 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:52.553606 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f4bf7e04-7164-4871-898c-d6474ef97b5b tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:59:52.553606 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f4bf7e04-7164-4871-898c-d6474ef97b5b tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008097 May 10 13:59:52.553606 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1155 bytes} [Tue May 10 13:59:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 13:59:52.559236 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-01e651bf-3f43-4049-9f49-8bcb44ff97cb tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Calling method '.version_select at 0x7f5f7cff8280>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:59:53.949714 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-01e651bf-3f43-4049-9f49-8bcb44ff97cb tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] HTTP exception thrown: Volume tempest-invalid-1237169576 could not be found. May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-01e651bf-3f43-4049-9f49-8bcb44ff97cb tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Request method failure captured: May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1237169576 HTTP/1.1 May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_XZkRrxprIVE8b9ft0yGqMr7MxhHuwgecwmFvpCs53zzFgk85geTqYYntoGgLbMIYKTVTmJ6-g14ayR1wRQoalG_ll9TJ3yV8zqF3X_DQYwPpu5Wo-GXqcr4fQ3a08JQoLldAXDDja9-Ko-tW1RRIlaI2FND4sMDFxz7fDef-gUfo May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 0f9a7482ebae4ab7a98239a604687af9 May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-VolumesNegativeTest-517407191 May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 13:59:53.954432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-VolumesNegativeTest-517407191 May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 0f9a7482ebae4ab7a98239a604687af9 May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-VolumesNegativeTest-517407191 May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-VolumesNegativeTest-517407191-project May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 3bd34a0c3ce246ee855828b8224de95e May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-VolumesNegativeTest-517407191-project May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Volume tempest-invalid-1237169576 could not be found. May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': 'tempest-invalid-1237169576'} May 10 13:59:53.955795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1237169576 could not be found. (HTTP 404) (Request-ID: req-b53296e0-755e-4f0f-a152-fae08dce4a82) May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:53.956642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 13:59:53.957990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1237169576 could not be found. May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 13:59:53.959143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1237169576 could not be found. May 10 13:59:53.961950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:53.961950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:53.961950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:53.961950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:53.961950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:59:53.961950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:59:53.961950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:59:53.961950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:59:53.961950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1237169576 could not be found. May 10 13:59:53.961950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:53.963307 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-01e651bf-3f43-4049-9f49-8bcb44ff97cb tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Returning 404 to user: Volume tempest-invalid-1237169576 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:59:53.963307 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-01e651bf-3f43-4049-9f49-8bcb44ff97cb tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1237169576" status: 404 len: 99 microversion: 2.1 time: 1.407828 May 10 13:59:53.969678 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1217 bytes} [Tue May 10 13:59:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1237169576 => generated 99 bytes in 1413 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 13:59:53.974298 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d45425ec-0ef8-4456-a38f-8fd2b3121fcf tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004703 May 10 13:59:53.978249 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1139 bytes} [Tue May 10 13:59:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 13:59:53.989337 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d07be8da-583c-47c7-95c1-a501f2371a98 tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004150 May 10 13:59:53.989840 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1136 bytes} [Tue May 10 13:59:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 13:59:54.000749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6f2649ec-7b8c-4e34-835e-fbd0453f79ce tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Calling method '.version_select at 0x7f5f7d1cec10>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:59:54.604370 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-6f2649ec-7b8c-4e34-835e-fbd0453f79ce tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] HTTP exception thrown: Volume 28ee2247-d5ad-41eb-a882-a7052493bf64 could not be found. May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6f2649ec-7b8c-4e34-835e-fbd0453f79ce tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Request method failure captured: May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: DELETE /compute/v2.1/os-volumes/28ee2247-d5ad-41eb-a882-a7052493bf64 HTTP/1.1 May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_XZkRrxprIVE8b9ft0yGqMr7MxhHuwgecwmFvpCs53zzFgk85geTqYYntoGgLbMIYKTVTmJ6-g14ayR1wRQoalG_ll9TJ3yV8zqF3X_DQYwPpu5Wo-GXqcr4fQ3a08JQoLldAXDDja9-Ko-tW1RRIlaI2FND4sMDFxz7fDef-gUfo May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 0f9a7482ebae4ab7a98239a604687af9 May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-VolumesNegativeTest-517407191 May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 13:59:54.610497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-VolumesNegativeTest-517407191 May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 0f9a7482ebae4ab7a98239a604687af9 May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-VolumesNegativeTest-517407191 May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-VolumesNegativeTest-517407191-project May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 3bd34a0c3ce246ee855828b8224de95e May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-VolumesNegativeTest-517407191-project May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Volume 28ee2247-d5ad-41eb-a882-a7052493bf64 could not be found. May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '28ee2247-d5ad-41eb-a882-a7052493bf64'} May 10 13:59:54.611870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 28ee2247-d5ad-41eb-a882-a7052493bf64 could not be found. (HTTP 404) (Request-ID: req-bdb6ec8c-5190-45e8-85f6-a9f7a177dcdf) May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:54.612723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 13:59:54.615662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 28ee2247-d5ad-41eb-a882-a7052493bf64 could not be found. May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 13:59:54.619544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 28ee2247-d5ad-41eb-a882-a7052493bf64 could not be found. May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 28ee2247-d5ad-41eb-a882-a7052493bf64 could not be found. May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6f2649ec-7b8c-4e34-835e-fbd0453f79ce tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Returning 404 to user: Volume 28ee2247-d5ad-41eb-a882-a7052493bf64 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6f2649ec-7b8c-4e34-835e-fbd0453f79ce tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/28ee2247-d5ad-41eb-a882-a7052493bf64" status: 404 len: 109 microversion: 2.1 time: 0.617615 May 10 13:59:54.626681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 13:59:53 2022] DELETE /compute/v2.1/os-volumes/28ee2247-d5ad-41eb-a882-a7052493bf64 => generated 109 bytes in 630 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 13:59:54.634774 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-345c2470-0c09-4bd4-8810-a23917059fa4 tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Calling method '.version_select at 0x7f5f7cf40ee0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:59:54.684728 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-345c2470-0c09-4bd4-8810-a23917059fa4 tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] HTTP exception thrown: Volume 6b694115-1d63-4733-b832-7453b1d116bd could not be found. May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-345c2470-0c09-4bd4-8810-a23917059fa4 tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Request method failure captured: May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/os-volumes/6b694115-1d63-4733-b832-7453b1d116bd HTTP/1.1 May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_XZkRrxprIVE8b9ft0yGqMr7MxhHuwgecwmFvpCs53zzFgk85geTqYYntoGgLbMIYKTVTmJ6-g14ayR1wRQoalG_ll9TJ3yV8zqF3X_DQYwPpu5Wo-GXqcr4fQ3a08JQoLldAXDDja9-Ko-tW1RRIlaI2FND4sMDFxz7fDef-gUfo May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 0f9a7482ebae4ab7a98239a604687af9 May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-VolumesNegativeTest-517407191 May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 13:59:54.688401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f9a7482ebae4ab7a98239a604687af9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-VolumesNegativeTest-517407191 May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 0f9a7482ebae4ab7a98239a604687af9 May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-VolumesNegativeTest-517407191 May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-VolumesNegativeTest-517407191-project May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 3bd34a0c3ce246ee855828b8224de95e May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-VolumesNegativeTest-517407191-project May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Volume 6b694115-1d63-4733-b832-7453b1d116bd could not be found. May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '6b694115-1d63-4733-b832-7453b1d116bd'} May 10 13:59:54.690066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b694115-1d63-4733-b832-7453b1d116bd could not be found. (HTTP 404) (Request-ID: req-cf8f4c72-50c2-4620-977d-dda2ddd657b8) May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:54.691009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 13:59:54.692457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b694115-1d63-4733-b832-7453b1d116bd could not be found. May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 13:59:54.694873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 13:59:54.697485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b694115-1d63-4733-b832-7453b1d116bd could not be found. May 10 13:59:54.697485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:54.697485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:59:54.697485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:54.697485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:59:54.697485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:59:54.697485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:59:54.697485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:59:54.697485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:59:54.697485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b694115-1d63-4733-b832-7453b1d116bd could not be found. May 10 13:59:54.697485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 13:59:54.703489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-345c2470-0c09-4bd4-8810-a23917059fa4 tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] Returning 404 to user: Volume 6b694115-1d63-4733-b832-7453b1d116bd could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:59:54.704529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-345c2470-0c09-4bd4-8810-a23917059fa4 tempest-VolumesNegativeTest-517407191 tempest-VolumesNegativeTest-517407191-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/6b694115-1d63-4733-b832-7453b1d116bd" status: 404 len: 109 microversion: 2.1 time: 0.074118 May 10 13:59:54.706151 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 13:59:54 2022] GET /compute/v2.1/os-volumes/6b694115-1d63-4733-b832-7453b1d116bd => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 13:59:55.475464 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1359274809", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "networks": [{"uuid": "b57480f2-7be7-45f5-87c7-fe8c513253c5"}]}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:59:55.604908 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.network.neutron [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] validate_networks() for [('b57480f2-7be7-45f5-87c7-fe8c513253c5', None, None, None, None, None)] {{(pid=117153) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 13:59:58.460835 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Flavor limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 13:59:58.497923 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Image limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 13:59:58.497923 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Flavor pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 13:59:58.497923 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Image pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 13:59:58.497923 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 13:59:58.537289 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:58.537771 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:58.538569 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:58.540411 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:58.619385 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Getting quotas for project 854eb7b7a9a44ca283e9c95ce935624d. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 13:59:58.653876 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Getting quotas for user e2218b6609f344dc94f91247e8504e85 and project 854eb7b7a9a44ca283e9c95ce935624d. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 13:59:58.696746 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Going to run 1 instances... {{(pid=117153) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 13:59:58.699739 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 13:59:58.889273 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0d6de597-e916-4d94-95f2-ecbc3237a736 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.615402 May 10 13:59:58.890192 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 5/9] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 13:59:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 13:59:58.901356 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-080b26f0-6fa9-4470-af12-9ac63a89f762 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:59:58.902653 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-080b26f0-6fa9-4470-af12-9ac63a89f762 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 13:59:59.135653 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-080b26f0-6fa9-4470-af12-9ac63a89f762 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 13:59:59.158139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-080b26f0-6fa9-4470-af12-9ac63a89f762 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1215 microversion: 2.1 time: 0.261577 May 10 13:59:59.180744 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 5/10] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 13:59:58 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:00.190254 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-789fd1a9-73fe-4913-8227-3dbe39de45d5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:00.191054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-789fd1a9-73fe-4913-8227-3dbe39de45d5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:00.928817 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-789fd1a9-73fe-4913-8227-3dbe39de45d5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:00.976544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-789fd1a9-73fe-4913-8227-3dbe39de45d5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1215 microversion: 2.1 time: 0.783285 May 10 14:00:00.988781 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:00 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1215 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:01.995043 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-13447172-874a-49d3-91ad-339e4c5e7b3e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:01.995829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-13447172-874a-49d3-91ad-339e4c5e7b3e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:02.011948 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-13447172-874a-49d3-91ad-339e4c5e7b3e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:02.014341 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-13447172-874a-49d3-91ad-339e4c5e7b3e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:02.015478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-13447172-874a-49d3-91ad-339e4c5e7b3e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:02.019463 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-13447172-874a-49d3-91ad-339e4c5e7b3e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:02.539546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-13447172-874a-49d3-91ad-339e4c5e7b3e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:02.569214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-13447172-874a-49d3-91ad-339e4c5e7b3e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1267 microversion: 2.1 time: 0.571408 May 10 14:00:02.573208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:01 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1267 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:03.590652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1166457a-f71f-4d6b-aa86-2560c998e042 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:03.591276 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1166457a-f71f-4d6b-aa86-2560c998e042 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:03.603307 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1166457a-f71f-4d6b-aa86-2560c998e042 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:03.606757 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1166457a-f71f-4d6b-aa86-2560c998e042 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:03.612727 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1166457a-f71f-4d6b-aa86-2560c998e042 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:03.613265 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1166457a-f71f-4d6b-aa86-2560c998e042 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:04.996497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1166457a-f71f-4d6b-aa86-2560c998e042 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:05.048422 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1166457a-f71f-4d6b-aa86-2560c998e042 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1273 microversion: 2.1 time: 1.458775 May 10 14:00:05.050269 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:03 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1273 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:06.077229 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-af799649-a9c7-4f3f-9343-bbeea2bd64a0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:06.077962 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-af799649-a9c7-4f3f-9343-bbeea2bd64a0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:06.093092 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-af799649-a9c7-4f3f-9343-bbeea2bd64a0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:06.098116 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-af799649-a9c7-4f3f-9343-bbeea2bd64a0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:06.099153 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-af799649-a9c7-4f3f-9343-bbeea2bd64a0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:06.102985 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-af799649-a9c7-4f3f-9343-bbeea2bd64a0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:06.236466 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-af799649-a9c7-4f3f-9343-bbeea2bd64a0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:06.270019 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-af799649-a9c7-4f3f-9343-bbeea2bd64a0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1273 microversion: 2.1 time: 0.199567 May 10 14:00:06.272343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 7/14] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:06 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:06.678271 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4066fca9-aa6f-45f0-bb29-7ec174f526d1 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Action: 'create', calling method: .version_select at 0x7f5f7c5a4a60>, body: {"keypair": {"name": "tempest-keypair-1133810948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCl2BtR1lLdjxXcTBY9fUfnnTKJxBKKeuGhogxNj+gt3gPARFmfrudJt5BPd2nBLiDiFgCvpUGZfd8p6IyuqYbrp47orL8K/VSuRKA2G24qjZ10LKj9K0ewP28HH3z4Wlw=="}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:06.725752 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-4066fca9-aa6f-45f0-bb29-7ec174f526d1 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Getting quotas for project d19ea52173a04c8e8624b91ac0e3eb48. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:00:06.733247 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-4066fca9-aa6f-45f0-bb29-7ec174f526d1 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Getting quotas for user def10f42c8744e1d8526087c874ceedd and project d19ea52173a04c8e8624b91ac0e3eb48. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:00:06.805756 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4066fca9-aa6f-45f0-bb29-7ec174f526d1 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.581328 May 10 14:00:06.806373 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 8/15] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 14:00:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:00:07.289912 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-135dc8bd-5b35-4892-af77-934d960bd589 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:07.291612 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-135dc8bd-5b35-4892-af77-934d960bd589 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:07.305503 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-135dc8bd-5b35-4892-af77-934d960bd589 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:07.308216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-135dc8bd-5b35-4892-af77-934d960bd589 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:07.310886 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-135dc8bd-5b35-4892-af77-934d960bd589 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:07.314980 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-135dc8bd-5b35-4892-af77-934d960bd589 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:07.619892 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-135dc8bd-5b35-4892-af77-934d960bd589 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:07.628543 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-135dc8bd-5b35-4892-af77-934d960bd589 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1273 microversion: 2.1 time: 0.342871 May 10 14:00:07.629133 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:07 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1273 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:08.645406 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bae81773-a6ee-4687-a352-c3405b0c216a tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:08.646080 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bae81773-a6ee-4687-a352-c3405b0c216a tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:08.661871 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bae81773-a6ee-4687-a352-c3405b0c216a tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:08.662340 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bae81773-a6ee-4687-a352-c3405b0c216a tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:08.673127 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bae81773-a6ee-4687-a352-c3405b0c216a tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:08.673614 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bae81773-a6ee-4687-a352-c3405b0c216a tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:09.152820 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bae81773-a6ee-4687-a352-c3405b0c216a tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:09.162443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bae81773-a6ee-4687-a352-c3405b0c216a tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1273 microversion: 2.1 time: 0.520843 May 10 14:00:09.163045 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 9/17] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:08 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1273 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:10.181357 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e4714711-9f76-4dd2-89f2-73bfd8cf21f0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:10.182213 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e4714711-9f76-4dd2-89f2-73bfd8cf21f0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:10.201401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4714711-9f76-4dd2-89f2-73bfd8cf21f0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:10.202022 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4714711-9f76-4dd2-89f2-73bfd8cf21f0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:10.202881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4714711-9f76-4dd2-89f2-73bfd8cf21f0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:10.203332 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4714711-9f76-4dd2-89f2-73bfd8cf21f0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:11.896220 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e4714711-9f76-4dd2-89f2-73bfd8cf21f0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:11.909694 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e4714711-9f76-4dd2-89f2-73bfd8cf21f0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 1.733236 May 10 14:00:11.924140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 9/18] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:10 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:12.936358 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3ebcba5c-8fc7-4a2a-ac52-d1dac45b1d3b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:12.937261 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3ebcba5c-8fc7-4a2a-ac52-d1dac45b1d3b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:12.964425 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3ebcba5c-8fc7-4a2a-ac52-d1dac45b1d3b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:12.974525 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3ebcba5c-8fc7-4a2a-ac52-d1dac45b1d3b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:12.980049 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3ebcba5c-8fc7-4a2a-ac52-d1dac45b1d3b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:12.985571 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3ebcba5c-8fc7-4a2a-ac52-d1dac45b1d3b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:13.293880 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e12822f8-463b-4677-9717-6f635203c17a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Action: 'create', calling method: .version_select at 0x7f5f7c4ff700>, body: {"keypair": {"name": "tempest-keypair-1470184906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9NV2khvB5XPlbVBqkqBAO810aEjzJQchvSkHTN05CnZcB9plsO2MN1qsXCwF6DrK/GtR4F/vdAWhpUkfabgcQIG4F5I+k95/n4yi9t8irmTS0hA9l4Vp5d+qXag0Ui+w=="}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:13.362223 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-e12822f8-463b-4677-9717-6f635203c17a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Getting quotas for project dd39c2a00ace4575896bf3f045bedce1. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:00:13.380610 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-e12822f8-463b-4677-9717-6f635203c17a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Getting quotas for user 67535c1c99484689999ef478604e51d0 and project dd39c2a00ace4575896bf3f045bedce1. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:00:13.494324 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e12822f8-463b-4677-9717-6f635203c17a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.607184 May 10 14:00:13.505726 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 10/19] 10.222.0.49 () {62 vars in 1199 bytes} [Tue May 10 14:00:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 619 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 14:00:13.809531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3ebcba5c-8fc7-4a2a-ac52-d1dac45b1d3b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:13.822895 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3ebcba5c-8fc7-4a2a-ac52-d1dac45b1d3b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 0.888628 May 10 14:00:13.827226 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 10/20] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:12 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:14.621869 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2141690536", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad65d3a2-8251-4281-96ce-37b7d361be92"}], "security_groups": [{"name": "tempest-securitygroup--1238902095"}], "key_name": "tempest-keypair-1133810948", "user_data": "}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:14.842870 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c18b7b35-4ba2-499e-be59-d7403721dded tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:14.844238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c18b7b35-4ba2-499e-be59-d7403721dded tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:14.867034 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c18b7b35-4ba2-499e-be59-d7403721dded tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:14.867952 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c18b7b35-4ba2-499e-be59-d7403721dded tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:14.874941 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c18b7b35-4ba2-499e-be59-d7403721dded tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:14.877541 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c18b7b35-4ba2-499e-be59-d7403721dded tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:15.026036 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.network.neutron [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] validate_networks() for [('ad65d3a2-8251-4281-96ce-37b7d361be92', None, None, None, None, None)] {{(pid=117153) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:00:16.040204 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c18b7b35-4ba2-499e-be59-d7403721dded tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:16.055539 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c18b7b35-4ba2-499e-be59-d7403721dded tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 1.216918 May 10 14:00:16.070674 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 11/21] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:14 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:17.086074 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9952c4c7-ba04-453c-8ea8-231fa68a901d tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:17.095248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9952c4c7-ba04-453c-8ea8-231fa68a901d tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:17.117362 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9952c4c7-ba04-453c-8ea8-231fa68a901d tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:17.125554 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9952c4c7-ba04-453c-8ea8-231fa68a901d tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:17.133503 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9952c4c7-ba04-453c-8ea8-231fa68a901d tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:17.143497 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9952c4c7-ba04-453c-8ea8-231fa68a901d tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:17.553790 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9952c4c7-ba04-453c-8ea8-231fa68a901d tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:17.562021 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9952c4c7-ba04-453c-8ea8-231fa68a901d tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 0.479665 May 10 14:00:17.562609 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 12/22] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:17 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:18.426360 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-01f5fddb-49a6-4ec9-b8c4-2c88ec4508c2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: .version_select at 0x7f5f7cdfa430>, body: {"keypair": {"name": "tempest-keypair-1466898890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8A2/K5t22SbrouRWjCbb4WdPtFRoXUxa4kgIEvD0OxK3MFq3d+RSr7grX6E2NxCJM2Wj2Gn+A1G0PockVcgDgZ8+FZ10uDH84+2UMaVejAFbn/OPcXT8G6fpVXd11GBg=="}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:18.546599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-01f5fddb-49a6-4ec9-b8c4-2c88ec4508c2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'key_pairs'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:00:18.554632 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-01f5fddb-49a6-4ec9-b8c4-2c88ec4508c2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for user 8c563c6a229b4e619992ccfb0da1a748 and project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'key_pairs'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:00:18.706937 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-01f5fddb-49a6-4ec9-b8c4-2c88ec4508c2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.139014 May 10 14:00:18.708353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 13/23] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 14:00:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:18.890060 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1461795765", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:19.104258 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Flavor limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:00:19.104783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Image limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:00:19.105157 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Flavor pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:00:19.105571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Image pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:00:19.105987 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:00:19.131801 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:19.132281 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] validate_networks() for [('74785619-4d29-47a9-9c74-95cf48855a3c', None, None, None, None, None)] {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:00:19.137048 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:19.138182 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:19.149855 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:19.218242 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Getting quotas for project d19ea52173a04c8e8624b91ac0e3eb48. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:00:19.230572 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Getting quotas for user def10f42c8744e1d8526087c874ceedd and project d19ea52173a04c8e8624b91ac0e3eb48. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:00:19.293039 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Going to run 1 instances... {{(pid=117153) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:00:19.295841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:00:19.581491 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f9a3ed7a-aede-4b17-8b1b-d05887ad2f2b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.964346 May 10 14:00:19.585391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 11/24] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:00:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 4969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:00:19.610748 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-521bee3a-9ce2-4e88-b4d4-f6f8eb7caedb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:19.613843 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-521bee3a-9ce2-4e88-b4d4-f6f8eb7caedb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:19.634542 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-521bee3a-9ce2-4e88-b4d4-f6f8eb7caedb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:19.637216 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-521bee3a-9ce2-4e88-b4d4-f6f8eb7caedb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:19.638806 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-521bee3a-9ce2-4e88-b4d4-f6f8eb7caedb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:19.642101 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-521bee3a-9ce2-4e88-b4d4-f6f8eb7caedb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:21.231319 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-521bee3a-9ce2-4e88-b4d4-f6f8eb7caedb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:21.254921 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-521bee3a-9ce2-4e88-b4d4-f6f8eb7caedb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 1.667602 May 10 14:00:21.258111 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 12/25] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:19 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:21.467199 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-5381ef71-c552-4c15-ba63-96a1a414af67 req-8894ed83-411b-4879-a608-bc59f0450af3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "983a758b-f633-43b1-9215-c91fadb59ff6", "tag": "32493f7b-bc46-42f6-a393-ade265851e55"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:21.505137 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-5381ef71-c552-4c15-ba63-96a1a414af67 req-8894ed83-411b-4879-a608-bc59f0450af3 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:21.505984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-5381ef71-c552-4c15-ba63-96a1a414af67 req-8894ed83-411b-4879-a608-bc59f0450af3 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:21.587566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-5381ef71-c552-4c15-ba63-96a1a414af67 req-8894ed83-411b-4879-a608-bc59f0450af3 service nova] Creating event network-changed:32493f7b-bc46-42f6-a393-ade265851e55 for instance 983a758b-f633-43b1-9215-c91fadb59ff6 on hv-cinder-84067 May 10 14:00:21.593123 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-5381ef71-c552-4c15-ba63-96a1a414af67 req-8894ed83-411b-4879-a608-bc59f0450af3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117153) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 14:00:21.594779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f17019eb-5aa1-421d-9150-d77bcf3fe137 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:21.595571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f17019eb-5aa1-421d-9150-d77bcf3fe137 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:21.598035 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f17019eb-5aa1-421d-9150-d77bcf3fe137 None None] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:21.599364 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f17019eb-5aa1-421d-9150-d77bcf3fe137 None None] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:21.631232 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.compute.rpcapi [None req-f17019eb-5aa1-421d-9150-d77bcf3fe137 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 14:00:21.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f17019eb-5aa1-421d-9150-d77bcf3fe137 None None] Releasing lock "compute-rpcapi-router" {{(pid=117153) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 14:00:21.705551 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f17019eb-5aa1-421d-9150-d77bcf3fe137 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.445992 May 10 14:00:21.706725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 13/26] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:21.712367 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-93d2853b-bcac-440c-92c0-6c69a088b771 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:21.718047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-93d2853b-bcac-440c-92c0-6c69a088b771 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:21.746857 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-93d2853b-bcac-440c-92c0-6c69a088b771 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:21.768858 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-93d2853b-bcac-440c-92c0-6c69a088b771 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:21.774920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-93d2853b-bcac-440c-92c0-6c69a088b771 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:21.775557 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-93d2853b-bcac-440c-92c0-6c69a088b771 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:22.257225 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:00:22.259946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:00:22.260466 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:00:22.260886 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:00:22.261478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:00:22.283624 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:22.285459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:22.291869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:22.292586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:22.365065 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Getting quotas for project 368287ad726146f88559c73a86e4b26d. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:00:22.373580 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Getting quotas for user bd14de0fd51c4fd89d9875b9c47100cc and project 368287ad726146f88559c73a86e4b26d. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:00:22.388079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:00:22.393849 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:00:22.558193 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-93d2853b-bcac-440c-92c0-6c69a088b771 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:22.567370 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-523dfcc6-439f-4988-a229-7063944739e5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.855359 May 10 14:00:22.573108 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 14/27] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:00:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:00:22.573709 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bc57276c-b4a0-47bc-9623-519b53e31ef1 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:22.574305 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-bc57276c-b4a0-47bc-9623-519b53e31ef1 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:22.589357 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-93d2853b-bcac-440c-92c0-6c69a088b771 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1242 microversion: 2.1 time: 0.881167 May 10 14:00:22.592289 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 14/28] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:21 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1242 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:22.595978 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bc57276c-b4a0-47bc-9623-519b53e31ef1 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:22.596505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bc57276c-b4a0-47bc-9623-519b53e31ef1 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:22.604820 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bc57276c-b4a0-47bc-9623-519b53e31ef1 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:22.605434 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bc57276c-b4a0-47bc-9623-519b53e31ef1 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:22.635765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a5b4826e-48c2-4792-b8f7-299cc8031533 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:22.639161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a5b4826e-48c2-4792-b8f7-299cc8031533 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:23.002587 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a5b4826e-48c2-4792-b8f7-299cc8031533 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:23.045519 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a5b4826e-48c2-4792-b8f7-299cc8031533 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1222 microversion: 2.1 time: 0.444682 May 10 14:00:23.046295 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 15/29] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:22 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1222 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:23.252915 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1551829672", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:23.328873 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.network.neutron [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] validate_networks() for [('74785619-4d29-47a9-9c74-95cf48855a3c', None, None, None, None, None)] {{(pid=117153) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:00:23.522131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-bc57276c-b4a0-47bc-9623-519b53e31ef1 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:23.530853 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-bc57276c-b4a0-47bc-9623-519b53e31ef1 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 0.961274 May 10 14:00:23.535026 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 15/30] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:22 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:23.608503 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-82c7a98b-5b91-42f2-bc03-320d0ceae47c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:23.609231 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-82c7a98b-5b91-42f2-bc03-320d0ceae47c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:23.630303 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-82c7a98b-5b91-42f2-bc03-320d0ceae47c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:23.636684 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-82c7a98b-5b91-42f2-bc03-320d0ceae47c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:23.638356 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-82c7a98b-5b91-42f2-bc03-320d0ceae47c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:23.639157 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-82c7a98b-5b91-42f2-bc03-320d0ceae47c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:23.863396 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-82c7a98b-5b91-42f2-bc03-320d0ceae47c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:23.872515 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-82c7a98b-5b91-42f2-bc03-320d0ceae47c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1298 microversion: 2.1 time: 0.267490 May 10 14:00:23.873119 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 16/31] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:23 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1298 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:24.391504 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-408307878", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c2e159f-7eb2-470d-9799-bf81a94b9b35"}], "security_groups": [{"name": "tempest-securitygroup--607043239"}], "key_name": "tempest-keypair-1470184906", "user_data": "}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:24.713270 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] validate_networks() for [('9c2e159f-7eb2-470d-9799-bf81a94b9b35', None, None, None, None, None)] {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:00:25.348908 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:00:25.349785 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:00:25.350421 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:00:25.351214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:00:25.351853 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:00:25.363204 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:25.364006 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:25.365060 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:25.365731 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:25.411095 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Getting quotas for project dd39c2a00ace4575896bf3f045bedce1. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:00:25.415493 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Getting quotas for user 67535c1c99484689999ef478604e51d0 and project dd39c2a00ace4575896bf3f045bedce1. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:00:25.428523 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:00:25.431316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:00:25.506277 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-07e7b0dc-317f-4435-9a0f-1c2b00a4875d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.123330 May 10 14:00:25.512375 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 17/32] 10.222.0.49 () {62 vars in 1187 bytes} [Tue May 10 14:00:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 14:00:25.514399 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0dd49c15-90d5-4131-8178-39ceabcc95eb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:25.515172 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0dd49c15-90d5-4131-8178-39ceabcc95eb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:25.524374 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0dd49c15-90d5-4131-8178-39ceabcc95eb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:25.525050 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0dd49c15-90d5-4131-8178-39ceabcc95eb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:25.529745 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0dd49c15-90d5-4131-8178-39ceabcc95eb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:25.530398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0dd49c15-90d5-4131-8178-39ceabcc95eb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:25.755515 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Flavor limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:00:25.756092 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Image limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:00:25.756500 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Flavor pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:00:25.756923 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Image pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:00:25.757342 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:00:25.770508 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:25.770971 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:25.771822 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:25.772324 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:25.785156 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0dd49c15-90d5-4131-8178-39ceabcc95eb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:25.795935 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0dd49c15-90d5-4131-8178-39ceabcc95eb tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 0.286365 May 10 14:00:25.796932 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 18/33] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:25 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:25.802663 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-21962471", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c9ceeee-200d-4bc2-b027-788cdb69321a"}], "security_groups": [{"name": "tempest-securitygroup--271925914"}], "key_name": "tempest-keypair-1466898890", "user_data": "}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:25.822474 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Getting quotas for project 368287ad726146f88559c73a86e4b26d. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:00:25.832972 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Getting quotas for user bd14de0fd51c4fd89d9875b9c47100cc and project 368287ad726146f88559c73a86e4b26d. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:00:25.871295 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Going to run 1 instances... {{(pid=117153) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:00:25.875426 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:00:26.015620 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] validate_networks() for [('2c9ceeee-200d-4bc2-b027-788cdb69321a', None, None, None, None, None)] {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:00:26.027748 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8aef62d0-e327-4b92-813c-2f391c69788b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.778886 May 10 14:00:26.030224 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 16/34] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:00:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:00:26.039442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a17ffef7-49bc-4349-be36-30b931a05d46 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:26.045457 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a17ffef7-49bc-4349-be36-30b931a05d46 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:26.060442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a17ffef7-49bc-4349-be36-30b931a05d46 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:26.061257 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a17ffef7-49bc-4349-be36-30b931a05d46 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:26.062401 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a17ffef7-49bc-4349-be36-30b931a05d46 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:26.063049 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a17ffef7-49bc-4349-be36-30b931a05d46 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:26.338037 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a17ffef7-49bc-4349-be36-30b931a05d46 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:26.349239 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a17ffef7-49bc-4349-be36-30b931a05d46 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1296 microversion: 2.1 time: 0.317474 May 10 14:00:26.359193 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 17/35] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:26 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1296 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:26.369586 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-edd4cd0d-7895-4f0c-8f4f-a68de5dc28d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:26.370253 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-edd4cd0d-7895-4f0c-8f4f-a68de5dc28d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:26.405104 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-edd4cd0d-7895-4f0c-8f4f-a68de5dc28d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:26.406707 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-edd4cd0d-7895-4f0c-8f4f-a68de5dc28d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:26.407527 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-edd4cd0d-7895-4f0c-8f4f-a68de5dc28d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:26.409140 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-edd4cd0d-7895-4f0c-8f4f-a68de5dc28d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:26.595299 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-edd4cd0d-7895-4f0c-8f4f-a68de5dc28d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:26.615147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-edd4cd0d-7895-4f0c-8f4f-a68de5dc28d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:26.617945 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-edd4cd0d-7895-4f0c-8f4f-a68de5dc28d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:26.619383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-edd4cd0d-7895-4f0c-8f4f-a68de5dc28d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1277 microversion: 2.20 time: 0.264531 May 10 14:00:26.633150 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 18/36] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:26 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1277 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:26.643965 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-12472d62-ce43-4a79-b3af-4f8a8cff259c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:26.647521 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-12472d62-ce43-4a79-b3af-4f8a8cff259c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:26.774938 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-12472d62-ce43-4a79-b3af-4f8a8cff259c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:26.787262 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-12472d62-ce43-4a79-b3af-4f8a8cff259c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1222 microversion: 2.1 time: 0.150073 May 10 14:00:26.798620 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 19/37] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:26 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1222 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:26.814234 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c884202f-3e2e-40ca-a36d-2fb13f17a7c4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:26.815196 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c884202f-3e2e-40ca-a36d-2fb13f17a7c4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:26.843635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c884202f-3e2e-40ca-a36d-2fb13f17a7c4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:26.846245 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c884202f-3e2e-40ca-a36d-2fb13f17a7c4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:26.847086 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c884202f-3e2e-40ca-a36d-2fb13f17a7c4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:26.847549 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c884202f-3e2e-40ca-a36d-2fb13f17a7c4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:27.091772 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:00:27.092357 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:00:27.092854 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:00:27.093273 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:00:27.093685 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:00:27.127418 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:27.127910 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:27.139662 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:27.141425 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:27.207071 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:00:27.224199 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for user 8c563c6a229b4e619992ccfb0da1a748 and project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:00:27.255171 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:00:27.258056 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:00:27.398525 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-eebac21d-be62-44da-90e5-8a15443b6959 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.595540 May 10 14:00:27.404405 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 19/38] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:00:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:00:27.422998 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0ae154a4-3133-4caf-b989-95a20b620497 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:27.428513 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0ae154a4-3133-4caf-b989-95a20b620497 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:27.448906 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0ae154a4-3133-4caf-b989-95a20b620497 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:27.452293 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0ae154a4-3133-4caf-b989-95a20b620497 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:27.456748 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0ae154a4-3133-4caf-b989-95a20b620497 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:27.459181 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0ae154a4-3133-4caf-b989-95a20b620497 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:27.545204 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c884202f-3e2e-40ca-a36d-2fb13f17a7c4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:27.554987 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c884202f-3e2e-40ca-a36d-2fb13f17a7c4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 0.745188 May 10 14:00:27.562989 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 20/39] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:26 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:27.591711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-10f286ee-7667-4fc5-8e2c-02557de54092 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:27.592921 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-10f286ee-7667-4fc5-8e2c-02557de54092 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:27.674989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0ae154a4-3133-4caf-b989-95a20b620497 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:27.684861 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0ae154a4-3133-4caf-b989-95a20b620497 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1296 microversion: 2.1 time: 0.278625 May 10 14:00:27.689483 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 20/40] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:27 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1296 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:27.706435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0db183ff-3ed6-462d-ab9a-f5af3ca921e8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:27.708856 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0db183ff-3ed6-462d-ab9a-f5af3ca921e8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:27.724705 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0db183ff-3ed6-462d-ab9a-f5af3ca921e8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:27.725852 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0db183ff-3ed6-462d-ab9a-f5af3ca921e8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:27.725993 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0db183ff-3ed6-462d-ab9a-f5af3ca921e8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:27.726396 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0db183ff-3ed6-462d-ab9a-f5af3ca921e8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:27.851975 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0db183ff-3ed6-462d-ab9a-f5af3ca921e8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:27.860453 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0db183ff-3ed6-462d-ab9a-f5af3ca921e8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:27.862012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0db183ff-3ed6-462d-ab9a-f5af3ca921e8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:27.863159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0db183ff-3ed6-462d-ab9a-f5af3ca921e8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1339 microversion: 2.20 time: 0.172690 May 10 14:00:27.863973 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 21/41] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:27 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1339 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:27.869831 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0d1e21a1-f292-4e70-ac63-11d89848b20e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:27.888081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0d1e21a1-f292-4e70-ac63-11d89848b20e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:27.907068 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0d1e21a1-f292-4e70-ac63-11d89848b20e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:27.907531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0d1e21a1-f292-4e70-ac63-11d89848b20e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:27.908349 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0d1e21a1-f292-4e70-ac63-11d89848b20e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:27.916827 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0d1e21a1-f292-4e70-ac63-11d89848b20e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:28.010174 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-10f286ee-7667-4fc5-8e2c-02557de54092 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:28.022128 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-10f286ee-7667-4fc5-8e2c-02557de54092 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1240 microversion: 2.1 time: 0.453683 May 10 14:00:28.025851 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 21/42] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:27 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1240 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:28.196119 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0d1e21a1-f292-4e70-ac63-11d89848b20e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:28.210727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0d1e21a1-f292-4e70-ac63-11d89848b20e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1274 microversion: 2.1 time: 0.343679 May 10 14:00:28.213872 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 22/43] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:27 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1274 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:28.578863 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-98b0fa09-d7fd-4b29-b461-b7e3bdd66cb6 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:28.579409 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-98b0fa09-d7fd-4b29-b461-b7e3bdd66cb6 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:28.589326 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-98b0fa09-d7fd-4b29-b461-b7e3bdd66cb6 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:28.590089 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-98b0fa09-d7fd-4b29-b461-b7e3bdd66cb6 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:28.591278 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-98b0fa09-d7fd-4b29-b461-b7e3bdd66cb6 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:28.591729 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-98b0fa09-d7fd-4b29-b461-b7e3bdd66cb6 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:28.705118 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-45cac590-496f-4561-8893-dbdd29eaa5cf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:28.705902 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-45cac590-496f-4561-8893-dbdd29eaa5cf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:28.720117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-45cac590-496f-4561-8893-dbdd29eaa5cf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:28.720705 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-45cac590-496f-4561-8893-dbdd29eaa5cf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:28.721604 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-45cac590-496f-4561-8893-dbdd29eaa5cf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:28.723144 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-45cac590-496f-4561-8893-dbdd29eaa5cf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:28.920346 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-98b0fa09-d7fd-4b29-b461-b7e3bdd66cb6 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:28.928793 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-98b0fa09-d7fd-4b29-b461-b7e3bdd66cb6 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 0.353787 May 10 14:00:28.933590 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 22/44] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:28 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:28.938629 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-58d99d7a-8441-420f-8a7f-26067c337adf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:28.939259 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-58d99d7a-8441-420f-8a7f-26067c337adf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:28.958413 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-58d99d7a-8441-420f-8a7f-26067c337adf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:28.959392 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-58d99d7a-8441-420f-8a7f-26067c337adf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:28.962504 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-58d99d7a-8441-420f-8a7f-26067c337adf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:28.963153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-58d99d7a-8441-420f-8a7f-26067c337adf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:29.100977 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-58d99d7a-8441-420f-8a7f-26067c337adf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:29.112375 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-58d99d7a-8441-420f-8a7f-26067c337adf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:29.114098 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-58d99d7a-8441-420f-8a7f-26067c337adf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:29.117024 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-58d99d7a-8441-420f-8a7f-26067c337adf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1339 microversion: 2.20 time: 0.182155 May 10 14:00:29.119723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 23/45] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:28 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1339 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:29.135460 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c2d0e89d-cc77-48a7-bf6b-bfa032919096 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:29.136086 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c2d0e89d-cc77-48a7-bf6b-bfa032919096 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:29.156034 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c2d0e89d-cc77-48a7-bf6b-bfa032919096 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:29.156769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c2d0e89d-cc77-48a7-bf6b-bfa032919096 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:29.157693 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c2d0e89d-cc77-48a7-bf6b-bfa032919096 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:29.158277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c2d0e89d-cc77-48a7-bf6b-bfa032919096 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:29.245576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-45cac590-496f-4561-8893-dbdd29eaa5cf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:29.260840 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-45cac590-496f-4561-8893-dbdd29eaa5cf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.559518 May 10 14:00:29.270278 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 23/46] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:28 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:29.270536 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c2d0e89d-cc77-48a7-bf6b-bfa032919096 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:29.273673 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-17b7b4b0-cca7-4364-b121-68c8a9991bce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:29.276937 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-17b7b4b0-cca7-4364-b121-68c8a9991bce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:29.279440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c2d0e89d-cc77-48a7-bf6b-bfa032919096 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1244 microversion: 2.1 time: 0.158315 May 10 14:00:29.280657 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 24/47] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:29 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1244 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:29.285425 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-17b7b4b0-cca7-4364-b121-68c8a9991bce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:29.286199 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-17b7b4b0-cca7-4364-b121-68c8a9991bce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:29.287206 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-17b7b4b0-cca7-4364-b121-68c8a9991bce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:29.288144 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-17b7b4b0-cca7-4364-b121-68c8a9991bce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:29.406045 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-17b7b4b0-cca7-4364-b121-68c8a9991bce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:29.421806 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-17b7b4b0-cca7-4364-b121-68c8a9991bce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1274 microversion: 2.1 time: 0.159289 May 10 14:00:29.422403 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 24/48] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:29 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:29.945603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-107394df-2eeb-4247-9772-d854803e167e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:29.946576 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-107394df-2eeb-4247-9772-d854803e167e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:29.953468 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-107394df-2eeb-4247-9772-d854803e167e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:29.953929 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-107394df-2eeb-4247-9772-d854803e167e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:29.954714 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-107394df-2eeb-4247-9772-d854803e167e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:29.955159 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-107394df-2eeb-4247-9772-d854803e167e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:30.103234 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-107394df-2eeb-4247-9772-d854803e167e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:30.110612 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-107394df-2eeb-4247-9772-d854803e167e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 0.169046 May 10 14:00:30.111784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 25/49] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:29 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:30.138088 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-22718649-33f4-4df2-b302-f5e5472f3d08 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:30.138772 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-22718649-33f4-4df2-b302-f5e5472f3d08 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:30.145352 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-22718649-33f4-4df2-b302-f5e5472f3d08 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:30.146021 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-22718649-33f4-4df2-b302-f5e5472f3d08 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:30.146953 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-22718649-33f4-4df2-b302-f5e5472f3d08 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:30.147393 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-22718649-33f4-4df2-b302-f5e5472f3d08 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:30.278047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7352c2f2-55c5-4013-aea4-3369ae2fee92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:30.278680 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7352c2f2-55c5-4013-aea4-3369ae2fee92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:30.284481 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7352c2f2-55c5-4013-aea4-3369ae2fee92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:30.285166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7352c2f2-55c5-4013-aea4-3369ae2fee92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:30.286307 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7352c2f2-55c5-4013-aea4-3369ae2fee92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:30.286963 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7352c2f2-55c5-4013-aea4-3369ae2fee92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:30.288945 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-22718649-33f4-4df2-b302-f5e5472f3d08 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:30.297848 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-22718649-33f4-4df2-b302-f5e5472f3d08 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:30.299375 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-22718649-33f4-4df2-b302-f5e5472f3d08 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:30.300547 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-22718649-33f4-4df2-b302-f5e5472f3d08 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.167377 May 10 14:00:30.301272 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 25/50] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:30 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:30.305995 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9d8eda6b-6181-4a2d-879d-130df07cdf4f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:30.306604 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9d8eda6b-6181-4a2d-879d-130df07cdf4f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:30.313539 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9d8eda6b-6181-4a2d-879d-130df07cdf4f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:30.313992 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9d8eda6b-6181-4a2d-879d-130df07cdf4f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:30.314849 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9d8eda6b-6181-4a2d-879d-130df07cdf4f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:30.315291 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9d8eda6b-6181-4a2d-879d-130df07cdf4f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:30.378212 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9d8eda6b-6181-4a2d-879d-130df07cdf4f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:30.390869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9d8eda6b-6181-4a2d-879d-130df07cdf4f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1244 microversion: 2.1 time: 0.088343 May 10 14:00:30.396549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 26/51] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:30 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:30.440286 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c22d8211-4b2f-4a16-a3ab-df27b56b7b94 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:30.441249 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c22d8211-4b2f-4a16-a3ab-df27b56b7b94 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:30.451042 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c22d8211-4b2f-4a16-a3ab-df27b56b7b94 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:30.452313 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c22d8211-4b2f-4a16-a3ab-df27b56b7b94 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:30.453456 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c22d8211-4b2f-4a16-a3ab-df27b56b7b94 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:30.454055 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c22d8211-4b2f-4a16-a3ab-df27b56b7b94 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:30.461805 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7352c2f2-55c5-4013-aea4-3369ae2fee92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:30.482230 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7352c2f2-55c5-4013-aea4-3369ae2fee92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.206160 May 10 14:00:30.484689 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 26/52] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:30 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:30.594613 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c22d8211-4b2f-4a16-a3ab-df27b56b7b94 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:30.602982 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c22d8211-4b2f-4a16-a3ab-df27b56b7b94 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1282 microversion: 2.1 time: 0.168680 May 10 14:00:30.604844 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 27/53] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:30 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:31.128405 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-20dc04a4-11f0-401f-b9f9-7b71ef2a8ab5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:31.129180 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-20dc04a4-11f0-401f-b9f9-7b71ef2a8ab5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:31.137465 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-20dc04a4-11f0-401f-b9f9-7b71ef2a8ab5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:31.139074 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-20dc04a4-11f0-401f-b9f9-7b71ef2a8ab5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:31.141304 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-20dc04a4-11f0-401f-b9f9-7b71ef2a8ab5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:31.142983 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-20dc04a4-11f0-401f-b9f9-7b71ef2a8ab5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:31.179161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-123655b2-4bac-48de-bbee-2df7450089a1 req-a2fde215-7c8d-49e9-a90e-b4e9524b7a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983a758b-f633-43b1-9215-c91fadb59ff6", "name": "network-vif-plugged", "status": "completed", "tag": "32493f7b-bc46-42f6-a393-ade265851e55"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:31.189619 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-123655b2-4bac-48de-bbee-2df7450089a1 req-a2fde215-7c8d-49e9-a90e-b4e9524b7a3a service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:31.190903 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-123655b2-4bac-48de-bbee-2df7450089a1 req-a2fde215-7c8d-49e9-a90e-b4e9524b7a3a service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:31.203468 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-123655b2-4bac-48de-bbee-2df7450089a1 req-a2fde215-7c8d-49e9-a90e-b4e9524b7a3a service nova] Creating event network-vif-plugged:32493f7b-bc46-42f6-a393-ade265851e55 for instance 983a758b-f633-43b1-9215-c91fadb59ff6 on hv-cinder-84067 May 10 14:00:31.209249 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-123655b2-4bac-48de-bbee-2df7450089a1 req-a2fde215-7c8d-49e9-a90e-b4e9524b7a3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128739 May 10 14:00:31.210035 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 27/54] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:31.321711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-36b82e81-a08c-48d4-99e6-ef66bdc088a6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:31.322637 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-36b82e81-a08c-48d4-99e6-ef66bdc088a6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:31.330776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-36b82e81-a08c-48d4-99e6-ef66bdc088a6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:31.331818 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-36b82e81-a08c-48d4-99e6-ef66bdc088a6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:31.333094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-36b82e81-a08c-48d4-99e6-ef66bdc088a6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:31.333649 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-36b82e81-a08c-48d4-99e6-ef66bdc088a6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:31.494334 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-20dc04a4-11f0-401f-b9f9-7b71ef2a8ab5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:31.510570 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-20dc04a4-11f0-401f-b9f9-7b71ef2a8ab5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 0.387506 May 10 14:00:31.512138 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 28/55] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:31 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:31.522824 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-b69c1bf4-3566-4cff-970a-6fa2933a2e24 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:31.525032 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-b69c1bf4-3566-4cff-970a-6fa2933a2e24 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:31.535980 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b69c1bf4-3566-4cff-970a-6fa2933a2e24 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:31.544567 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b69c1bf4-3566-4cff-970a-6fa2933a2e24 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:31.545552 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b69c1bf4-3566-4cff-970a-6fa2933a2e24 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:31.557958 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b69c1bf4-3566-4cff-970a-6fa2933a2e24 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:31.643053 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-b69c1bf4-3566-4cff-970a-6fa2933a2e24 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:31.652458 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-b69c1bf4-3566-4cff-970a-6fa2933a2e24 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1236 microversion: 2.1 time: 0.138252 May 10 14:00:31.653523 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 29/56] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:31 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1236 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:31.658949 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8e87812b-7472-4e0a-bb64-850a3f173cdb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:31.659846 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8e87812b-7472-4e0a-bb64-850a3f173cdb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:31.667159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8e87812b-7472-4e0a-bb64-850a3f173cdb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:31.667736 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8e87812b-7472-4e0a-bb64-850a3f173cdb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:31.669030 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8e87812b-7472-4e0a-bb64-850a3f173cdb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:31.669688 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8e87812b-7472-4e0a-bb64-850a3f173cdb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:31.928203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-36b82e81-a08c-48d4-99e6-ef66bdc088a6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:31.937523 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-36b82e81-a08c-48d4-99e6-ef66bdc088a6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:31.939486 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-36b82e81-a08c-48d4-99e6-ef66bdc088a6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:31.948303 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8e87812b-7472-4e0a-bb64-850a3f173cdb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:31.951093 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-36b82e81-a08c-48d4-99e6-ef66bdc088a6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.624585 May 10 14:00:31.951762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 28/57] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:31 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:31.956906 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8e87812b-7472-4e0a-bb64-850a3f173cdb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.301630 May 10 14:00:31.957532 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b80199ea-caf3-4b7e-8d22-81f6e84dd084 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:31.957924 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 30/58] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:31 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:31.967614 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b80199ea-caf3-4b7e-8d22-81f6e84dd084 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:31.973767 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b80199ea-caf3-4b7e-8d22-81f6e84dd084 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:31.974216 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b80199ea-caf3-4b7e-8d22-81f6e84dd084 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:31.975329 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b80199ea-caf3-4b7e-8d22-81f6e84dd084 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:31.975662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b80199ea-caf3-4b7e-8d22-81f6e84dd084 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:32.062426 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-3e1391dc-ef94-4338-a2ae-da23069f5d22 req-798b7f9c-f78b-40d1-b51d-b789edd4369c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067bd8aa-a9d7-41f4-82a3-54e00fe64f68", "tag": "0b32a17e-9e2f-475d-abe1-8b69acb4c76a"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:32.073670 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-3e1391dc-ef94-4338-a2ae-da23069f5d22 req-798b7f9c-f78b-40d1-b51d-b789edd4369c service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:32.074342 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-3e1391dc-ef94-4338-a2ae-da23069f5d22 req-798b7f9c-f78b-40d1-b51d-b789edd4369c service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:32.098904 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-3e1391dc-ef94-4338-a2ae-da23069f5d22 req-798b7f9c-f78b-40d1-b51d-b789edd4369c service nova] Creating event network-changed:0b32a17e-9e2f-475d-abe1-8b69acb4c76a for instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 on hv-cinder-84067 May 10 14:00:32.099607 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-3e1391dc-ef94-4338-a2ae-da23069f5d22 req-798b7f9c-f78b-40d1-b51d-b789edd4369c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117154) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 14:00:32.100926 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-eaa23fcd-fdca-44de-8e97-f7290a1b5ea2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:32.101511 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-eaa23fcd-fdca-44de-8e97-f7290a1b5ea2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:32.102442 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-eaa23fcd-fdca-44de-8e97-f7290a1b5ea2 None None] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:32.103013 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-eaa23fcd-fdca-44de-8e97-f7290a1b5ea2 None None] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:32.113534 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.compute.rpcapi [None req-eaa23fcd-fdca-44de-8e97-f7290a1b5ea2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 14:00:32.114570 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-eaa23fcd-fdca-44de-8e97-f7290a1b5ea2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117154) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 14:00:32.132373 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-eaa23fcd-fdca-44de-8e97-f7290a1b5ea2 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173025 May 10 14:00:32.136431 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 31/59] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:32.137735 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b80199ea-caf3-4b7e-8d22-81f6e84dd084 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:32.145889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b80199ea-caf3-4b7e-8d22-81f6e84dd084 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1280 microversion: 2.1 time: 0.192279 May 10 14:00:32.153394 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 29/60] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:31 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1280 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:32.445856 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-00e17598-6b55-40d9-ae3e-d30fc1e8dd15 req-5cbc4d53-122e-480c-beed-ddc2f9814ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22e54ed-bbfa-42df-af34-67721740c4b0", "tag": "48a907c3-b5e2-4fd8-b6cb-cc60b528bc16"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:32.459295 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-00e17598-6b55-40d9-ae3e-d30fc1e8dd15 req-5cbc4d53-122e-480c-beed-ddc2f9814ed9 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:32.460380 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-00e17598-6b55-40d9-ae3e-d30fc1e8dd15 req-5cbc4d53-122e-480c-beed-ddc2f9814ed9 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:32.473022 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-00e17598-6b55-40d9-ae3e-d30fc1e8dd15 req-5cbc4d53-122e-480c-beed-ddc2f9814ed9 service nova] Creating event network-changed:48a907c3-b5e2-4fd8-b6cb-cc60b528bc16 for instance c22e54ed-bbfa-42df-af34-67721740c4b0 on hv-cinder-84067 May 10 14:00:32.478949 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-00e17598-6b55-40d9-ae3e-d30fc1e8dd15 req-5cbc4d53-122e-480c-beed-ddc2f9814ed9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037611 May 10 14:00:32.479642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 32/61] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:32.530434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f2c8c54c-037c-4c3c-ae20-040ffafd0130 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:32.542993 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f2c8c54c-037c-4c3c-ae20-040ffafd0130 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:32.555310 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f2c8c54c-037c-4c3c-ae20-040ffafd0130 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:32.555765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f2c8c54c-037c-4c3c-ae20-040ffafd0130 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:32.556771 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f2c8c54c-037c-4c3c-ae20-040ffafd0130 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:32.557367 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f2c8c54c-037c-4c3c-ae20-040ffafd0130 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:32.671018 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-fcddfd04-65b2-449e-950c-27eed6e6a3b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:32.671984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-fcddfd04-65b2-449e-950c-27eed6e6a3b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:32.679255 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fcddfd04-65b2-449e-950c-27eed6e6a3b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:32.679742 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fcddfd04-65b2-449e-950c-27eed6e6a3b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:32.680565 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fcddfd04-65b2-449e-950c-27eed6e6a3b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:32.681195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fcddfd04-65b2-449e-950c-27eed6e6a3b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:32.749103 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f2c8c54c-037c-4c3c-ae20-040ffafd0130 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:32.755988 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-fcddfd04-65b2-449e-950c-27eed6e6a3b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:32.761337 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f2c8c54c-037c-4c3c-ae20-040ffafd0130 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 0.236200 May 10 14:00:32.762012 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 30/62] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:32 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:32.763390 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-fcddfd04-65b2-449e-950c-27eed6e6a3b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1236 microversion: 2.1 time: 0.097066 May 10 14:00:32.764124 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 33/63] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:32 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1236 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:32.974493 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d0dce01d-22d9-4671-9287-3397f702e371 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:32.976351 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-db66c003-ea05-4279-bc4c-cadbac4e0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:32.977141 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d0dce01d-22d9-4671-9287-3397f702e371 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:32.979476 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-db66c003-ea05-4279-bc4c-cadbac4e0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:32.987030 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d0dce01d-22d9-4671-9287-3397f702e371 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:32.987482 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d0dce01d-22d9-4671-9287-3397f702e371 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:32.988311 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d0dce01d-22d9-4671-9287-3397f702e371 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:32.988802 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d0dce01d-22d9-4671-9287-3397f702e371 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:32.993974 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-db66c003-ea05-4279-bc4c-cadbac4e0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:32.994431 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-db66c003-ea05-4279-bc4c-cadbac4e0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:32.995208 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-db66c003-ea05-4279-bc4c-cadbac4e0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:32.995657 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-db66c003-ea05-4279-bc4c-cadbac4e0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:33.166318 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d0dce01d-22d9-4671-9287-3397f702e371 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:33.179057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d0dce01d-22d9-4671-9287-3397f702e371 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.208606 May 10 14:00:33.181333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 34/64] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:32 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:33.186747 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-6d14f65f-b33c-41e4-9b47-bbf6ec7f828b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:33.187477 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-6d14f65f-b33c-41e4-9b47-bbf6ec7f828b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:33.194838 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6d14f65f-b33c-41e4-9b47-bbf6ec7f828b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:33.195560 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6d14f65f-b33c-41e4-9b47-bbf6ec7f828b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:33.196598 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6d14f65f-b33c-41e4-9b47-bbf6ec7f828b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:33.197281 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6d14f65f-b33c-41e4-9b47-bbf6ec7f828b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:33.210807 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-db66c003-ea05-4279-bc4c-cadbac4e0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:33.220333 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-db66c003-ea05-4279-bc4c-cadbac4e0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:33.233941 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-db66c003-ea05-4279-bc4c-cadbac4e0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:33.235637 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-db66c003-ea05-4279-bc4c-cadbac4e0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.269112 May 10 14:00:33.236312 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 31/65] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:32 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:33.283238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-6d14f65f-b33c-41e4-9b47-bbf6ec7f828b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:33.295907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-6d14f65f-b33c-41e4-9b47-bbf6ec7f828b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1280 microversion: 2.1 time: 0.113251 May 10 14:00:33.296832 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 35/66] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:33 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1280 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:33.780397 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f2e544a1-d172-4c54-9804-1c67ae6e85fc tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:33.780939 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-fca81995-4104-4969-9ed2-ca496aa3fd54 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:33.781646 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-fca81995-4104-4969-9ed2-ca496aa3fd54 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:33.782114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f2e544a1-d172-4c54-9804-1c67ae6e85fc tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:33.790574 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f2e544a1-d172-4c54-9804-1c67ae6e85fc tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:33.790843 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fca81995-4104-4969-9ed2-ca496aa3fd54 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:33.791311 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f2e544a1-d172-4c54-9804-1c67ae6e85fc tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:33.791795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fca81995-4104-4969-9ed2-ca496aa3fd54 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:33.792219 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f2e544a1-d172-4c54-9804-1c67ae6e85fc tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:33.792662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f2e544a1-d172-4c54-9804-1c67ae6e85fc tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:33.793306 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fca81995-4104-4969-9ed2-ca496aa3fd54 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:33.794880 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fca81995-4104-4969-9ed2-ca496aa3fd54 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:33.890737 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-fca81995-4104-4969-9ed2-ca496aa3fd54 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:33.898009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-fca81995-4104-4969-9ed2-ca496aa3fd54 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1292 microversion: 2.1 time: 0.121634 May 10 14:00:33.898879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 36/67] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:33 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1292 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:34.200907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-250e62cb-2e22-44b1-8cd5-c7a161611a61 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:34.202434 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-250e62cb-2e22-44b1-8cd5-c7a161611a61 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:34.217145 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-250e62cb-2e22-44b1-8cd5-c7a161611a61 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:34.220044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-250e62cb-2e22-44b1-8cd5-c7a161611a61 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:34.235963 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-250e62cb-2e22-44b1-8cd5-c7a161611a61 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:34.236803 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-250e62cb-2e22-44b1-8cd5-c7a161611a61 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:34.525341 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f2e544a1-d172-4c54-9804-1c67ae6e85fc tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:34.537389 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f2e544a1-d172-4c54-9804-1c67ae6e85fc tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 0.762336 May 10 14:00:34.539718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 32/68] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:33 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:34.547888 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-94e58b73-d0d2-443e-bbba-d0cecfc6a4f7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:34.550256 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-94e58b73-d0d2-443e-bbba-d0cecfc6a4f7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:34.576360 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-94e58b73-d0d2-443e-bbba-d0cecfc6a4f7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:34.577065 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-94e58b73-d0d2-443e-bbba-d0cecfc6a4f7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:34.578165 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-94e58b73-d0d2-443e-bbba-d0cecfc6a4f7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:34.578630 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-94e58b73-d0d2-443e-bbba-d0cecfc6a4f7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:34.590554 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-250e62cb-2e22-44b1-8cd5-c7a161611a61 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:34.604989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-250e62cb-2e22-44b1-8cd5-c7a161611a61 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.409719 May 10 14:00:34.606726 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 37/69] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:34 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:34.614649 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0fde4315-fabe-4bb2-baf6-7a0226a0d68f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:34.630590 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0fde4315-fabe-4bb2-baf6-7a0226a0d68f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:34.646124 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0fde4315-fabe-4bb2-baf6-7a0226a0d68f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:34.654530 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0fde4315-fabe-4bb2-baf6-7a0226a0d68f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:34.656024 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0fde4315-fabe-4bb2-baf6-7a0226a0d68f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:34.656686 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0fde4315-fabe-4bb2-baf6-7a0226a0d68f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:35.025218 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0fde4315-fabe-4bb2-baf6-7a0226a0d68f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:35.036413 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0fde4315-fabe-4bb2-baf6-7a0226a0d68f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.428563 May 10 14:00:35.037189 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 38/70] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:34 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:35.052590 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-50f268c8-dc13-4520-8dd3-103ec63b7989 req-b8599922-cb6f-4506-8ec7-5aed66ada4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54be9a2c-c327-4249-ba65-0fc49162bac7", "tag": "54c8afe4-b86d-4757-bf04-f87c35143a83"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:35.063545 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-50f268c8-dc13-4520-8dd3-103ec63b7989 req-b8599922-cb6f-4506-8ec7-5aed66ada4f4 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:35.064138 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-50f268c8-dc13-4520-8dd3-103ec63b7989 req-b8599922-cb6f-4506-8ec7-5aed66ada4f4 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:35.102667 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-50f268c8-dc13-4520-8dd3-103ec63b7989 req-b8599922-cb6f-4506-8ec7-5aed66ada4f4 service nova] Creating event network-changed:54c8afe4-b86d-4757-bf04-f87c35143a83 for instance 54be9a2c-c327-4249-ba65-0fc49162bac7 on hv-cinder-84067 May 10 14:00:35.109750 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-50f268c8-dc13-4520-8dd3-103ec63b7989 req-b8599922-cb6f-4506-8ec7-5aed66ada4f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071196 May 10 14:00:35.111254 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 39/71] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:35.117721 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9884d21b-6ce5-47c7-84f0-e26149e93846 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:35.118663 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9884d21b-6ce5-47c7-84f0-e26149e93846 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:35.125838 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9884d21b-6ce5-47c7-84f0-e26149e93846 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:35.126631 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9884d21b-6ce5-47c7-84f0-e26149e93846 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:35.127880 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9884d21b-6ce5-47c7-84f0-e26149e93846 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:35.128486 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9884d21b-6ce5-47c7-84f0-e26149e93846 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:35.185969 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-94e58b73-d0d2-443e-bbba-d0cecfc6a4f7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:35.194231 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-94e58b73-d0d2-443e-bbba-d0cecfc6a4f7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:35.195775 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-94e58b73-d0d2-443e-bbba-d0cecfc6a4f7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:35.196931 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-94e58b73-d0d2-443e-bbba-d0cecfc6a4f7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.654024 May 10 14:00:35.197571 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9884d21b-6ce5-47c7-84f0-e26149e93846 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:35.197691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 33/72] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:34 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:35.206357 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9884d21b-6ce5-47c7-84f0-e26149e93846 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1298 microversion: 2.1 time: 0.093445 May 10 14:00:35.206944 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 40/73] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:35 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:35.557772 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-dc0026b1-92d8-4820-bedd-3c0d98757cf0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:35.558394 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-dc0026b1-92d8-4820-bedd-3c0d98757cf0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:35.576342 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dc0026b1-92d8-4820-bedd-3c0d98757cf0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:35.576800 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dc0026b1-92d8-4820-bedd-3c0d98757cf0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:35.577692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dc0026b1-92d8-4820-bedd-3c0d98757cf0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:35.578226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dc0026b1-92d8-4820-bedd-3c0d98757cf0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:35.628248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a159bd29-af95-4c8f-bf08-2d19319c41e0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:35.629154 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a159bd29-af95-4c8f-bf08-2d19319c41e0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:35.635405 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a159bd29-af95-4c8f-bf08-2d19319c41e0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:35.635872 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a159bd29-af95-4c8f-bf08-2d19319c41e0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:35.636669 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a159bd29-af95-4c8f-bf08-2d19319c41e0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:35.637132 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a159bd29-af95-4c8f-bf08-2d19319c41e0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:35.862749 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a159bd29-af95-4c8f-bf08-2d19319c41e0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:35.870832 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a159bd29-af95-4c8f-bf08-2d19319c41e0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.252349 May 10 14:00:35.885747 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 41/74] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:35 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:36.054899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-52e3ff42-8962-4cac-84cb-3e3867ca70ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:36.055533 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-52e3ff42-8962-4cac-84cb-3e3867ca70ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:36.061584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-52e3ff42-8962-4cac-84cb-3e3867ca70ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:36.062035 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-52e3ff42-8962-4cac-84cb-3e3867ca70ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:36.062838 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-52e3ff42-8962-4cac-84cb-3e3867ca70ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:36.063278 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-52e3ff42-8962-4cac-84cb-3e3867ca70ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:36.112148 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-dc0026b1-92d8-4820-bedd-3c0d98757cf0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:36.122540 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-dc0026b1-92d8-4820-bedd-3c0d98757cf0 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 0.567829 May 10 14:00:36.123560 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 34/75] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:35 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:36.203761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-52e3ff42-8962-4cac-84cb-3e3867ca70ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:36.214160 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-52e3ff42-8962-4cac-84cb-3e3867ca70ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.163550 May 10 14:00:36.218060 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1a663e2d-8571-4373-87ff-26c9d9e862d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:36.219907 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1a663e2d-8571-4373-87ff-26c9d9e862d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:36.226291 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 42/76] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:36 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:36.229809 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1a663e2d-8571-4373-87ff-26c9d9e862d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:36.230394 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1a663e2d-8571-4373-87ff-26c9d9e862d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:36.232038 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1a663e2d-8571-4373-87ff-26c9d9e862d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:36.232589 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1a663e2d-8571-4373-87ff-26c9d9e862d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:36.234995 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a55ac73e-9dc6-4f23-9534-61e496c656fe tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:36.235501 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a55ac73e-9dc6-4f23-9534-61e496c656fe tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:36.252198 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a55ac73e-9dc6-4f23-9534-61e496c656fe tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:36.252706 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a55ac73e-9dc6-4f23-9534-61e496c656fe tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:36.255681 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a55ac73e-9dc6-4f23-9534-61e496c656fe tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:36.256653 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a55ac73e-9dc6-4f23-9534-61e496c656fe tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:36.346077 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a55ac73e-9dc6-4f23-9534-61e496c656fe tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:36.354112 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a55ac73e-9dc6-4f23-9534-61e496c656fe tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1298 microversion: 2.1 time: 0.126550 May 10 14:00:36.354882 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 43/77] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:36 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:36.527105 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1a663e2d-8571-4373-87ff-26c9d9e862d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:36.541827 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1a663e2d-8571-4373-87ff-26c9d9e862d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:36.544703 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1a663e2d-8571-4373-87ff-26c9d9e862d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:36.546934 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1a663e2d-8571-4373-87ff-26c9d9e862d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.335639 May 10 14:00:36.548077 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 35/78] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:36 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:00:36.895393 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-af398543-7c43-42fe-bf08-1c6e13681514 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:36.896057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-af398543-7c43-42fe-bf08-1c6e13681514 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:36.904823 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-af398543-7c43-42fe-bf08-1c6e13681514 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:36.905293 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-af398543-7c43-42fe-bf08-1c6e13681514 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:36.906088 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-af398543-7c43-42fe-bf08-1c6e13681514 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:36.906527 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-af398543-7c43-42fe-bf08-1c6e13681514 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:37.146068 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-18e3a610-96d7-43e6-8b82-1ef1637cf15c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:37.150671 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-18e3a610-96d7-43e6-8b82-1ef1637cf15c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:37.158457 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-18e3a610-96d7-43e6-8b82-1ef1637cf15c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:37.159113 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-18e3a610-96d7-43e6-8b82-1ef1637cf15c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:37.160047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-18e3a610-96d7-43e6-8b82-1ef1637cf15c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:37.160828 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-18e3a610-96d7-43e6-8b82-1ef1637cf15c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:37.174207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-af398543-7c43-42fe-bf08-1c6e13681514 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:37.186129 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-af398543-7c43-42fe-bf08-1c6e13681514 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.294878 May 10 14:00:37.189313 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 44/79] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:36 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:37.231657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-26cdcf53-5ac3-418f-8535-1b3e6cd524c5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:37.232313 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-26cdcf53-5ac3-418f-8535-1b3e6cd524c5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:37.238467 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-26cdcf53-5ac3-418f-8535-1b3e6cd524c5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:37.238913 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-26cdcf53-5ac3-418f-8535-1b3e6cd524c5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:37.239868 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-26cdcf53-5ac3-418f-8535-1b3e6cd524c5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:37.240344 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-26cdcf53-5ac3-418f-8535-1b3e6cd524c5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:37.381829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-26cdcf53-5ac3-418f-8535-1b3e6cd524c5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:37.390637 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-26cdcf53-5ac3-418f-8535-1b3e6cd524c5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.163053 May 10 14:00:37.391239 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 45/80] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:37 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:37.396902 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-4df9a3b3-5531-4d7a-9bda-2077a9b620c3 req-0b43b004-e82b-46c3-97f3-a337afda086d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c99093de-3e49-4cee-b398-90c326ef8050", "tag": "0f558f56-6f77-4669-b4bd-6cfd29789243"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:37.401627 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-18e3a610-96d7-43e6-8b82-1ef1637cf15c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:37.409787 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-18e3a610-96d7-43e6-8b82-1ef1637cf15c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1315 microversion: 2.1 time: 0.267623 May 10 14:00:37.417512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 36/81] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:37 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:37.417512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6ed39a7a-2c74-4346-b341-1e25dbaab9c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:37.417512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-6ed39a7a-2c74-4346-b341-1e25dbaab9c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:37.420730 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-4df9a3b3-5531-4d7a-9bda-2077a9b620c3 req-0b43b004-e82b-46c3-97f3-a337afda086d service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:37.421186 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-4df9a3b3-5531-4d7a-9bda-2077a9b620c3 req-0b43b004-e82b-46c3-97f3-a337afda086d service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:37.423287 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ed39a7a-2c74-4346-b341-1e25dbaab9c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:37.423912 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ed39a7a-2c74-4346-b341-1e25dbaab9c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:37.424722 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ed39a7a-2c74-4346-b341-1e25dbaab9c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:37.425318 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ed39a7a-2c74-4346-b341-1e25dbaab9c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:37.432327 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-4df9a3b3-5531-4d7a-9bda-2077a9b620c3 req-0b43b004-e82b-46c3-97f3-a337afda086d service nova] Creating event network-changed:0f558f56-6f77-4669-b4bd-6cfd29789243 for instance c99093de-3e49-4cee-b398-90c326ef8050 on hv-cinder-84067 May 10 14:00:37.438587 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-4df9a3b3-5531-4d7a-9bda-2077a9b620c3 req-0b43b004-e82b-46c3-97f3-a337afda086d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045972 May 10 14:00:37.439193 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 46/82] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:37.562326 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6ed39a7a-2c74-4346-b341-1e25dbaab9c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:37.574043 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c3b8ca22-46a2-482e-8ed9-4bae84cce037 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:37.575332 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c3b8ca22-46a2-482e-8ed9-4bae84cce037 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:37.580536 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6ed39a7a-2c74-4346-b341-1e25dbaab9c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.168433 May 10 14:00:37.581137 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 37/83] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:37 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:37.584819 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c3b8ca22-46a2-482e-8ed9-4bae84cce037 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:37.585288 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c3b8ca22-46a2-482e-8ed9-4bae84cce037 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:37.586211 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c3b8ca22-46a2-482e-8ed9-4bae84cce037 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:37.586486 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c3b8ca22-46a2-482e-8ed9-4bae84cce037 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:37.733389 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c3b8ca22-46a2-482e-8ed9-4bae84cce037 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:37.741307 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c3b8ca22-46a2-482e-8ed9-4bae84cce037 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:37.742814 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c3b8ca22-46a2-482e-8ed9-4bae84cce037 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:37.743914 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c3b8ca22-46a2-482e-8ed9-4bae84cce037 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.174935 May 10 14:00:37.744550 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 47/84] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:37 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:00:38.206438 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-797810e6-efec-4332-802c-837e731f08a5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:38.207083 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-797810e6-efec-4332-802c-837e731f08a5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:38.213948 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-797810e6-efec-4332-802c-837e731f08a5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:38.214399 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-797810e6-efec-4332-802c-837e731f08a5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:38.215819 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-797810e6-efec-4332-802c-837e731f08a5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:38.216299 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-797810e6-efec-4332-802c-837e731f08a5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:38.353575 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-797810e6-efec-4332-802c-837e731f08a5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:38.361077 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-797810e6-efec-4332-802c-837e731f08a5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.158533 May 10 14:00:38.361744 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 38/85] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:38 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:38.407485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5381bb40-8868-4ab2-8301-e84ffab593f1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:38.411297 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5381bb40-8868-4ab2-8301-e84ffab593f1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:38.417413 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5381bb40-8868-4ab2-8301-e84ffab593f1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:38.417867 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5381bb40-8868-4ab2-8301-e84ffab593f1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:38.418680 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5381bb40-8868-4ab2-8301-e84ffab593f1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:38.419117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5381bb40-8868-4ab2-8301-e84ffab593f1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:38.428367 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8e076b95-9590-4633-916f-0e7d47e828d4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:38.428987 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8e076b95-9590-4633-916f-0e7d47e828d4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:38.435787 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8e076b95-9590-4633-916f-0e7d47e828d4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:38.436320 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8e076b95-9590-4633-916f-0e7d47e828d4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:38.437147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8e076b95-9590-4633-916f-0e7d47e828d4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:38.437595 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8e076b95-9590-4633-916f-0e7d47e828d4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:38.589384 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5381bb40-8868-4ab2-8301-e84ffab593f1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:38.598003 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5381bb40-8868-4ab2-8301-e84ffab593f1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.194883 May 10 14:00:38.598691 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 48/86] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:38 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:38.603706 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d5f9ca3c-81f3-42e2-9959-41c7d0570fca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:38.604468 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d5f9ca3c-81f3-42e2-9959-41c7d0570fca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:38.611772 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d5f9ca3c-81f3-42e2-9959-41c7d0570fca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:38.612323 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d5f9ca3c-81f3-42e2-9959-41c7d0570fca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:38.613428 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d5f9ca3c-81f3-42e2-9959-41c7d0570fca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:38.614681 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d5f9ca3c-81f3-42e2-9959-41c7d0570fca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:38.763365 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d5f9ca3c-81f3-42e2-9959-41c7d0570fca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:38.770693 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d5f9ca3c-81f3-42e2-9959-41c7d0570fca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.170670 May 10 14:00:38.771272 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 49/87] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:38 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:38.776080 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a95dd47f-4a5e-4304-bd72-5900d6cf99a0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:38.776710 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a95dd47f-4a5e-4304-bd72-5900d6cf99a0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:38.783411 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a95dd47f-4a5e-4304-bd72-5900d6cf99a0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:38.783851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a95dd47f-4a5e-4304-bd72-5900d6cf99a0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:38.784982 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a95dd47f-4a5e-4304-bd72-5900d6cf99a0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:38.785572 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a95dd47f-4a5e-4304-bd72-5900d6cf99a0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:38.931023 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a95dd47f-4a5e-4304-bd72-5900d6cf99a0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:38.939907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a95dd47f-4a5e-4304-bd72-5900d6cf99a0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:38.941709 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a95dd47f-4a5e-4304-bd72-5900d6cf99a0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:38.943032 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a95dd47f-4a5e-4304-bd72-5900d6cf99a0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.170680 May 10 14:00:38.943593 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 50/88] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:38 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:38.960901 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8e076b95-9590-4633-916f-0e7d47e828d4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:38.969015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8e076b95-9590-4633-916f-0e7d47e828d4 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1502 microversion: 2.1 time: 0.545682 May 10 14:00:38.969718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 39/89] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:38 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1502 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:39.378375 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ccaf7096-f488-4cd1-8618-fbcc39ed8914 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:39.378992 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ccaf7096-f488-4cd1-8618-fbcc39ed8914 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:39.385202 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ccaf7096-f488-4cd1-8618-fbcc39ed8914 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:39.385658 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ccaf7096-f488-4cd1-8618-fbcc39ed8914 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:39.386579 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ccaf7096-f488-4cd1-8618-fbcc39ed8914 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:39.387059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ccaf7096-f488-4cd1-8618-fbcc39ed8914 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:39.516058 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ccaf7096-f488-4cd1-8618-fbcc39ed8914 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:39.523936 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ccaf7096-f488-4cd1-8618-fbcc39ed8914 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.149620 May 10 14:00:39.524698 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 51/90] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:39 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:39.614784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6c72d3ed-93dc-47f6-a513-4308491fb59a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:39.615504 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-6c72d3ed-93dc-47f6-a513-4308491fb59a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:39.621514 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6c72d3ed-93dc-47f6-a513-4308491fb59a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:39.622134 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6c72d3ed-93dc-47f6-a513-4308491fb59a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:39.623044 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6c72d3ed-93dc-47f6-a513-4308491fb59a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:39.623548 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6c72d3ed-93dc-47f6-a513-4308491fb59a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:39.789426 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0cb96c52-eadf-451f-9c74-61f9d087eff2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:39.790884 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0cb96c52-eadf-451f-9c74-61f9d087eff2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:39.796864 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0cb96c52-eadf-451f-9c74-61f9d087eff2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:39.798128 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0cb96c52-eadf-451f-9c74-61f9d087eff2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:39.799139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0cb96c52-eadf-451f-9c74-61f9d087eff2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:39.799766 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0cb96c52-eadf-451f-9c74-61f9d087eff2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:39.845021 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6c72d3ed-93dc-47f6-a513-4308491fb59a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:39.864351 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6c72d3ed-93dc-47f6-a513-4308491fb59a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.253212 May 10 14:00:39.869923 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 40/91] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:39 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:39.937759 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-17079a28-6b8d-417a-bb86-64a9364170bb req-2c8e2d32-c098-4db5-987f-5b7ea5c7a5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e5f6640-8318-4ba7-be1f-7a578b595363", "tag": "11a4481d-f88f-4503-b4d7-f6b62b846773"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:39.962066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-17079a28-6b8d-417a-bb86-64a9364170bb req-2c8e2d32-c098-4db5-987f-5b7ea5c7a5e7 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:39.962578 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-17079a28-6b8d-417a-bb86-64a9364170bb req-2c8e2d32-c098-4db5-987f-5b7ea5c7a5e7 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:39.987823 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-17079a28-6b8d-417a-bb86-64a9364170bb req-2c8e2d32-c098-4db5-987f-5b7ea5c7a5e7 service nova] Creating event network-changed:11a4481d-f88f-4503-b4d7-f6b62b846773 for instance 1e5f6640-8318-4ba7-be1f-7a578b595363 on hv-cinder-84067 May 10 14:00:39.987823 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-17079a28-6b8d-417a-bb86-64a9364170bb req-2c8e2d32-c098-4db5-987f-5b7ea5c7a5e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058434 May 10 14:00:39.987823 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 41/92] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:39.995859 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e4d87e27-8a70-4116-b80f-9a64ddbf5eec tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:39.997468 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e4d87e27-8a70-4116-b80f-9a64ddbf5eec tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:40.005039 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e4d87e27-8a70-4116-b80f-9a64ddbf5eec tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:40.005502 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e4d87e27-8a70-4116-b80f-9a64ddbf5eec tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:40.006498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e4d87e27-8a70-4116-b80f-9a64ddbf5eec tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:40.007223 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e4d87e27-8a70-4116-b80f-9a64ddbf5eec tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:40.011586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0cb96c52-eadf-451f-9c74-61f9d087eff2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:40.022581 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0cb96c52-eadf-451f-9c74-61f9d087eff2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.236885 May 10 14:00:40.024202 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 52/93] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:39 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:40.165883 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e4d87e27-8a70-4116-b80f-9a64ddbf5eec tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:40.174864 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e4d87e27-8a70-4116-b80f-9a64ddbf5eec tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:40.176398 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e4d87e27-8a70-4116-b80f-9a64ddbf5eec tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:40.177503 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e4d87e27-8a70-4116-b80f-9a64ddbf5eec tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.186629 May 10 14:00:40.178062 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 42/94] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:39 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:40.417168 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-13d3aea4-4ca7-4d4d-b07b-b4f04385930f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62616346-ddf6-4eca-813d-b9a023a4b4b1"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:40.418563 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-13d3aea4-4ca7-4d4d-b07b-b4f04385930f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:40.427446 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-13d3aea4-4ca7-4d4d-b07b-b4f04385930f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:40.428136 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-13d3aea4-4ca7-4d4d-b07b-b4f04385930f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:40.429118 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-13d3aea4-4ca7-4d4d-b07b-b4f04385930f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:40.429551 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-13d3aea4-4ca7-4d4d-b07b-b4f04385930f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:40.542077 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e32bc156-db6f-420c-a7f8-d9893d008406 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:40.543184 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e32bc156-db6f-420c-a7f8-d9893d008406 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:40.560988 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e32bc156-db6f-420c-a7f8-d9893d008406 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:40.561839 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e32bc156-db6f-420c-a7f8-d9893d008406 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:40.563950 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e32bc156-db6f-420c-a7f8-d9893d008406 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:40.567780 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e32bc156-db6f-420c-a7f8-d9893d008406 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:40.936026 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-13d3aea4-4ca7-4d4d-b07b-b4f04385930f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "POST /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.522635 May 10 14:00:40.937858 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 53/95] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:00:40 2022] POST /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6/os-volume_attachments => generated 194 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:40.944483 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e269b55f-fd43-446d-99a0-8af0ebbb44fe tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:40.945906 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e269b55f-fd43-446d-99a0-8af0ebbb44fe tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:40.959781 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e269b55f-fd43-446d-99a0-8af0ebbb44fe tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:40.960268 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e269b55f-fd43-446d-99a0-8af0ebbb44fe tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:40.961480 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e269b55f-fd43-446d-99a0-8af0ebbb44fe tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:40.962225 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e269b55f-fd43-446d-99a0-8af0ebbb44fe tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:41.116617 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e269b55f-fd43-446d-99a0-8af0ebbb44fe tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:41.125991 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e269b55f-fd43-446d-99a0-8af0ebbb44fe tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.186464 May 10 14:00:41.126851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 54/96] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:40 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:41.132122 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-6d4df80a-7193-4b87-90a8-19b28bf0408a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:41.132834 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-6d4df80a-7193-4b87-90a8-19b28bf0408a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:41.138970 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6d4df80a-7193-4b87-90a8-19b28bf0408a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:41.139912 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6d4df80a-7193-4b87-90a8-19b28bf0408a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:41.140988 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6d4df80a-7193-4b87-90a8-19b28bf0408a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:41.141506 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6d4df80a-7193-4b87-90a8-19b28bf0408a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:41.166512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e32bc156-db6f-420c-a7f8-d9893d008406 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:41.174373 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e32bc156-db6f-420c-a7f8-d9893d008406 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.636717 May 10 14:00:41.175015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 43/97] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:40 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:41.194759 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1bc09764-9b6e-4063-b594-00c286411a56 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:41.195426 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1bc09764-9b6e-4063-b594-00c286411a56 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:41.203281 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1bc09764-9b6e-4063-b594-00c286411a56 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:41.203869 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1bc09764-9b6e-4063-b594-00c286411a56 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:41.204778 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1bc09764-9b6e-4063-b594-00c286411a56 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:41.205226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1bc09764-9b6e-4063-b594-00c286411a56 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:41.288608 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-6d4df80a-7193-4b87-90a8-19b28bf0408a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:41.304501 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-6d4df80a-7193-4b87-90a8-19b28bf0408a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.176120 May 10 14:00:41.317321 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 55/98] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:41 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:41.367156 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1bc09764-9b6e-4063-b594-00c286411a56 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:41.375828 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1bc09764-9b6e-4063-b594-00c286411a56 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:41.377588 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1bc09764-9b6e-4063-b594-00c286411a56 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:41.378972 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1bc09764-9b6e-4063-b594-00c286411a56 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.188146 May 10 14:00:41.379538 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 44/99] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:41 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:00:42.143394 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2ce99a95-4a6c-4f23-912a-450fd9ffde0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:42.144012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2ce99a95-4a6c-4f23-912a-450fd9ffde0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:42.150794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ce99a95-4a6c-4f23-912a-450fd9ffde0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:42.151202 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ce99a95-4a6c-4f23-912a-450fd9ffde0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:42.151975 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ce99a95-4a6c-4f23-912a-450fd9ffde0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:42.152453 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ce99a95-4a6c-4f23-912a-450fd9ffde0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:42.190716 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-09a98b6c-d38b-47c2-b34e-94d965dc2075 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:42.191336 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-09a98b6c-d38b-47c2-b34e-94d965dc2075 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:42.197160 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-09a98b6c-d38b-47c2-b34e-94d965dc2075 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:42.197617 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-09a98b6c-d38b-47c2-b34e-94d965dc2075 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:42.198392 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-09a98b6c-d38b-47c2-b34e-94d965dc2075 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:42.198829 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-09a98b6c-d38b-47c2-b34e-94d965dc2075 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:42.280975 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2ce99a95-4a6c-4f23-912a-450fd9ffde0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:42.288461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2ce99a95-4a6c-4f23-912a-450fd9ffde0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.148885 May 10 14:00:42.289214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 56/100] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:42 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:42.321677 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0af9583c-06aa-48cc-8888-6bef5e3c09d1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:42.322326 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0af9583c-06aa-48cc-8888-6bef5e3c09d1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:42.328415 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0af9583c-06aa-48cc-8888-6bef5e3c09d1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:42.328987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0af9583c-06aa-48cc-8888-6bef5e3c09d1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:42.330075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0af9583c-06aa-48cc-8888-6bef5e3c09d1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:42.330585 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0af9583c-06aa-48cc-8888-6bef5e3c09d1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:42.331943 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-09a98b6c-d38b-47c2-b34e-94d965dc2075 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:42.339122 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-09a98b6c-d38b-47c2-b34e-94d965dc2075 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.152117 May 10 14:00:42.339698 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 45/101] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:42 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:42.397119 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6f72db42-b054-472b-acb3-7f0c55cef5a5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:42.397729 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-6f72db42-b054-472b-acb3-7f0c55cef5a5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:42.404489 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6f72db42-b054-472b-acb3-7f0c55cef5a5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:42.404869 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6f72db42-b054-472b-acb3-7f0c55cef5a5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:42.405628 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6f72db42-b054-472b-acb3-7f0c55cef5a5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:42.406411 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6f72db42-b054-472b-acb3-7f0c55cef5a5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:42.461913 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0af9583c-06aa-48cc-8888-6bef5e3c09d1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:42.469929 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0af9583c-06aa-48cc-8888-6bef5e3c09d1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.151916 May 10 14:00:42.470531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 57/102] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:42 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:42.717218 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6f72db42-b054-472b-acb3-7f0c55cef5a5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:42.724985 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6f72db42-b054-472b-acb3-7f0c55cef5a5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:42.726507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6f72db42-b054-472b-acb3-7f0c55cef5a5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:42.727610 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6f72db42-b054-472b-acb3-7f0c55cef5a5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.334839 May 10 14:00:42.728193 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 46/103] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:42 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:00:43.305760 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e8bc01fd-81b4-4781-9043-934a85a879b0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:43.306328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e8bc01fd-81b4-4781-9043-934a85a879b0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:43.313166 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e8bc01fd-81b4-4781-9043-934a85a879b0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:43.313638 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e8bc01fd-81b4-4781-9043-934a85a879b0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:43.314590 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e8bc01fd-81b4-4781-9043-934a85a879b0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:43.315076 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e8bc01fd-81b4-4781-9043-934a85a879b0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:43.357265 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0be20216-0b3f-42a1-8c6d-0e96b330dab5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:43.357889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0be20216-0b3f-42a1-8c6d-0e96b330dab5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:43.363730 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0be20216-0b3f-42a1-8c6d-0e96b330dab5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:43.364270 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0be20216-0b3f-42a1-8c6d-0e96b330dab5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:43.365096 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0be20216-0b3f-42a1-8c6d-0e96b330dab5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:43.365539 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0be20216-0b3f-42a1-8c6d-0e96b330dab5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:43.453981 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e8bc01fd-81b4-4781-9043-934a85a879b0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:43.461419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e8bc01fd-81b4-4781-9043-934a85a879b0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.159508 May 10 14:00:43.462000 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 58/104] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:43 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:43.486302 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9c9807c1-e75e-4139-9f36-74ac9bb9f4fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:43.487150 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9c9807c1-e75e-4139-9f36-74ac9bb9f4fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:43.492947 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9c9807c1-e75e-4139-9f36-74ac9bb9f4fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:43.493396 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9c9807c1-e75e-4139-9f36-74ac9bb9f4fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:43.494163 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9c9807c1-e75e-4139-9f36-74ac9bb9f4fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:43.494608 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9c9807c1-e75e-4139-9f36-74ac9bb9f4fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:43.515604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0be20216-0b3f-42a1-8c6d-0e96b330dab5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:43.523280 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0be20216-0b3f-42a1-8c6d-0e96b330dab5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.170369 May 10 14:00:43.523836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 47/105] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:43 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:43.620028 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9c9807c1-e75e-4139-9f36-74ac9bb9f4fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:43.627692 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9c9807c1-e75e-4139-9f36-74ac9bb9f4fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.145216 May 10 14:00:43.628284 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 59/106] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:43 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:43.744741 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2095b20d-bfcb-43c1-9ce2-b3cf221d48e5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:43.745358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2095b20d-bfcb-43c1-9ce2-b3cf221d48e5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:43.751220 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2095b20d-bfcb-43c1-9ce2-b3cf221d48e5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:43.751671 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2095b20d-bfcb-43c1-9ce2-b3cf221d48e5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:43.752478 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2095b20d-bfcb-43c1-9ce2-b3cf221d48e5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:43.752918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2095b20d-bfcb-43c1-9ce2-b3cf221d48e5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:43.877938 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2095b20d-bfcb-43c1-9ce2-b3cf221d48e5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:43.885580 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2095b20d-bfcb-43c1-9ce2-b3cf221d48e5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:43.887101 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2095b20d-bfcb-43c1-9ce2-b3cf221d48e5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:43.888197 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2095b20d-bfcb-43c1-9ce2-b3cf221d48e5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.147682 May 10 14:00:43.888762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 48/107] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:43 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:44.478648 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-385aff1c-5fe3-4ae8-9c26-13e7227c6166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:44.480185 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-385aff1c-5fe3-4ae8-9c26-13e7227c6166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:44.489039 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-385aff1c-5fe3-4ae8-9c26-13e7227c6166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:44.489743 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-385aff1c-5fe3-4ae8-9c26-13e7227c6166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:44.490741 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-385aff1c-5fe3-4ae8-9c26-13e7227c6166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:44.491541 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-385aff1c-5fe3-4ae8-9c26-13e7227c6166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:44.540271 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-cae45f5c-aeb4-4692-a068-ebcabaaa3be8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:44.541537 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-cae45f5c-aeb4-4692-a068-ebcabaaa3be8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:44.552435 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cae45f5c-aeb4-4692-a068-ebcabaaa3be8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:44.552435 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cae45f5c-aeb4-4692-a068-ebcabaaa3be8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:44.552435 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cae45f5c-aeb4-4692-a068-ebcabaaa3be8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:44.552435 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cae45f5c-aeb4-4692-a068-ebcabaaa3be8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:44.661740 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-385aff1c-5fe3-4ae8-9c26-13e7227c6166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:44.670430 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-385aff1c-5fe3-4ae8-9c26-13e7227c6166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.195679 May 10 14:00:44.671023 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 60/108] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:44 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:44.675697 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5898dea6-82ae-430d-94ab-5f9de62c10a4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:44.676568 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5898dea6-82ae-430d-94ab-5f9de62c10a4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:44.682755 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5898dea6-82ae-430d-94ab-5f9de62c10a4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:44.683213 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5898dea6-82ae-430d-94ab-5f9de62c10a4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:44.684018 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5898dea6-82ae-430d-94ab-5f9de62c10a4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:44.684485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5898dea6-82ae-430d-94ab-5f9de62c10a4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:44.837330 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5898dea6-82ae-430d-94ab-5f9de62c10a4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:44.846416 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5898dea6-82ae-430d-94ab-5f9de62c10a4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.174101 May 10 14:00:44.847270 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 61/109] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:44 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:44.884025 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-cae45f5c-aeb4-4692-a068-ebcabaaa3be8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:44.895817 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-cae45f5c-aeb4-4692-a068-ebcabaaa3be8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.359502 May 10 14:00:44.896447 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 49/110] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:44 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:44.906846 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-59cc2325-ffda-4e47-95b2-3bf09dcd6778 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:44.907758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-59cc2325-ffda-4e47-95b2-3bf09dcd6778 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:44.913657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-59cc2325-ffda-4e47-95b2-3bf09dcd6778 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:44.914326 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-59cc2325-ffda-4e47-95b2-3bf09dcd6778 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:44.915109 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-59cc2325-ffda-4e47-95b2-3bf09dcd6778 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:44.915552 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-59cc2325-ffda-4e47-95b2-3bf09dcd6778 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:45.053243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-59cc2325-ffda-4e47-95b2-3bf09dcd6778 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:45.062319 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-59cc2325-ffda-4e47-95b2-3bf09dcd6778 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:45.064364 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-59cc2325-ffda-4e47-95b2-3bf09dcd6778 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:45.065537 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-59cc2325-ffda-4e47-95b2-3bf09dcd6778 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.163261 May 10 14:00:45.066476 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 62/111] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:44 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:45.516344 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-aff24676-a233-4f1d-b096-4ac1341ee448 req-bfb38509-83de-4d17-8bf8-ba1af192166c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54be9a2c-c327-4249-ba65-0fc49162bac7", "name": "network-vif-plugged", "status": "completed", "tag": "54c8afe4-b86d-4757-bf04-f87c35143a83"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:45.528934 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-aff24676-a233-4f1d-b096-4ac1341ee448 req-bfb38509-83de-4d17-8bf8-ba1af192166c service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:45.529546 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-aff24676-a233-4f1d-b096-4ac1341ee448 req-bfb38509-83de-4d17-8bf8-ba1af192166c service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:45.542043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-aff24676-a233-4f1d-b096-4ac1341ee448 req-bfb38509-83de-4d17-8bf8-ba1af192166c service nova] Creating event network-vif-plugged:54c8afe4-b86d-4757-bf04-f87c35143a83 for instance 54be9a2c-c327-4249-ba65-0fc49162bac7 on hv-cinder-84067 May 10 14:00:45.547545 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-aff24676-a233-4f1d-b096-4ac1341ee448 req-bfb38509-83de-4d17-8bf8-ba1af192166c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036212 May 10 14:00:45.548154 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 50/112] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:00:45.688265 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5c367f9c-b210-4c92-94ab-f3f4760ecd4b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:45.689062 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5c367f9c-b210-4c92-94ab-f3f4760ecd4b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:45.698854 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5c367f9c-b210-4c92-94ab-f3f4760ecd4b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:45.700612 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5c367f9c-b210-4c92-94ab-f3f4760ecd4b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:45.701668 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5c367f9c-b210-4c92-94ab-f3f4760ecd4b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:45.704795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5c367f9c-b210-4c92-94ab-f3f4760ecd4b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:45.865750 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-65d731ef-24b9-4a20-b8ac-ff285482267a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:45.866546 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-65d731ef-24b9-4a20-b8ac-ff285482267a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:45.881448 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-65d731ef-24b9-4a20-b8ac-ff285482267a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:45.881844 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-65d731ef-24b9-4a20-b8ac-ff285482267a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:45.883468 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-65d731ef-24b9-4a20-b8ac-ff285482267a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:45.883910 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-65d731ef-24b9-4a20-b8ac-ff285482267a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:45.884069 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5c367f9c-b210-4c92-94ab-f3f4760ecd4b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:45.896229 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5c367f9c-b210-4c92-94ab-f3f4760ecd4b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.212353 May 10 14:00:45.908359 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 63/113] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:45 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:45.918802 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-040778ec-f120-4379-91e6-6dbf5a61e965 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:45.919792 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-040778ec-f120-4379-91e6-6dbf5a61e965 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:45.926310 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-040778ec-f120-4379-91e6-6dbf5a61e965 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:45.926967 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-040778ec-f120-4379-91e6-6dbf5a61e965 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:45.930250 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-040778ec-f120-4379-91e6-6dbf5a61e965 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:45.930953 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-040778ec-f120-4379-91e6-6dbf5a61e965 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:46.087758 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-65d731ef-24b9-4a20-b8ac-ff285482267a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:46.095360 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-65d731ef-24b9-4a20-b8ac-ff285482267a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.234226 May 10 14:00:46.095939 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 51/114] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:45 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:46.100859 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-040778ec-f120-4379-91e6-6dbf5a61e965 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:46.106836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6786c87c-8b6f-4694-8e37-de75a34c9517 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:46.107521 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-6786c87c-8b6f-4694-8e37-de75a34c9517 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:46.110554 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-040778ec-f120-4379-91e6-6dbf5a61e965 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.196314 May 10 14:00:46.111163 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 64/115] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:45 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:46.115298 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6786c87c-8b6f-4694-8e37-de75a34c9517 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:46.115733 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6786c87c-8b6f-4694-8e37-de75a34c9517 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:46.116542 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6786c87c-8b6f-4694-8e37-de75a34c9517 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:46.116982 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6786c87c-8b6f-4694-8e37-de75a34c9517 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:46.252855 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6786c87c-8b6f-4694-8e37-de75a34c9517 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:46.262926 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6786c87c-8b6f-4694-8e37-de75a34c9517 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:46.264480 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6786c87c-8b6f-4694-8e37-de75a34c9517 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:46.265869 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6786c87c-8b6f-4694-8e37-de75a34c9517 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.168623 May 10 14:00:46.266437 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 52/116] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:46 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:46.915676 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-108ffbe1-c278-441e-96cf-3f1b5b0bb02b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:46.916339 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-108ffbe1-c278-441e-96cf-3f1b5b0bb02b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:46.938935 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-108ffbe1-c278-441e-96cf-3f1b5b0bb02b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:46.943598 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-108ffbe1-c278-441e-96cf-3f1b5b0bb02b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:46.945245 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-108ffbe1-c278-441e-96cf-3f1b5b0bb02b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:46.945935 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-108ffbe1-c278-441e-96cf-3f1b5b0bb02b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:47.114776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6c5a69bf-4a16-4323-b97a-ed5a1752dc9d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:47.115402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-6c5a69bf-4a16-4323-b97a-ed5a1752dc9d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:47.129684 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6c5a69bf-4a16-4323-b97a-ed5a1752dc9d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:47.130810 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6c5a69bf-4a16-4323-b97a-ed5a1752dc9d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:47.131770 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6c5a69bf-4a16-4323-b97a-ed5a1752dc9d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:47.135144 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6c5a69bf-4a16-4323-b97a-ed5a1752dc9d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:47.175542 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-108ffbe1-c278-441e-96cf-3f1b5b0bb02b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:47.183122 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-108ffbe1-c278-441e-96cf-3f1b5b0bb02b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.271909 May 10 14:00:47.195835 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 65/117] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:46 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:47.200515 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5dc91a8c-7e50-48b7-baf4-f864ebac8644 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:47.201162 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5dc91a8c-7e50-48b7-baf4-f864ebac8644 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:47.223509 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5dc91a8c-7e50-48b7-baf4-f864ebac8644 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:47.225304 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5dc91a8c-7e50-48b7-baf4-f864ebac8644 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:47.227074 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5dc91a8c-7e50-48b7-baf4-f864ebac8644 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:47.229522 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5dc91a8c-7e50-48b7-baf4-f864ebac8644 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:47.397340 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6c5a69bf-4a16-4323-b97a-ed5a1752dc9d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:47.413363 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6c5a69bf-4a16-4323-b97a-ed5a1752dc9d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.304728 May 10 14:00:47.419204 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 53/118] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:47 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:47.427083 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bfa89790-cc8e-485e-b8b3-c78766cded60 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:47.429308 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bfa89790-cc8e-485e-b8b3-c78766cded60 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:47.445249 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bfa89790-cc8e-485e-b8b3-c78766cded60 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:47.445765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bfa89790-cc8e-485e-b8b3-c78766cded60 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:47.446508 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bfa89790-cc8e-485e-b8b3-c78766cded60 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:47.446953 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bfa89790-cc8e-485e-b8b3-c78766cded60 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:47.476013 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5dc91a8c-7e50-48b7-baf4-f864ebac8644 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:47.485695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5dc91a8c-7e50-48b7-baf4-f864ebac8644 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.297437 May 10 14:00:47.486652 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 66/119] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:47 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:47.572908 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-3ac32081-451f-4c33-a7ce-caa6b94c4ebe req-18be133a-05d2-40a4-8f18-76c3a6637d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22e54ed-bbfa-42df-af34-67721740c4b0", "name": "network-vif-plugged", "status": "completed", "tag": "48a907c3-b5e2-4fd8-b6cb-cc60b528bc16"}, {"server_uuid": "067bd8aa-a9d7-41f4-82a3-54e00fe64f68", "name": "network-vif-plugged", "status": "completed", "tag": "0b32a17e-9e2f-475d-abe1-8b69acb4c76a"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:47.582355 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-3ac32081-451f-4c33-a7ce-caa6b94c4ebe req-18be133a-05d2-40a4-8f18-76c3a6637d58 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:47.583017 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-3ac32081-451f-4c33-a7ce-caa6b94c4ebe req-18be133a-05d2-40a4-8f18-76c3a6637d58 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:47.600011 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-3ac32081-451f-4c33-a7ce-caa6b94c4ebe req-18be133a-05d2-40a4-8f18-76c3a6637d58 service nova] Creating event network-vif-plugged:48a907c3-b5e2-4fd8-b6cb-cc60b528bc16 for instance c22e54ed-bbfa-42df-af34-67721740c4b0 on hv-cinder-84067 May 10 14:00:47.600658 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-3ac32081-451f-4c33-a7ce-caa6b94c4ebe req-18be133a-05d2-40a4-8f18-76c3a6637d58 service nova] Creating event network-vif-plugged:0b32a17e-9e2f-475d-abe1-8b69acb4c76a for instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 on hv-cinder-84067 May 10 14:00:47.607968 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-3ac32081-451f-4c33-a7ce-caa6b94c4ebe req-18be133a-05d2-40a4-8f18-76c3a6637d58 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039597 May 10 14:00:47.608740 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 67/120] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:47.678712 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bfa89790-cc8e-485e-b8b3-c78766cded60 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:47.688935 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bfa89790-cc8e-485e-b8b3-c78766cded60 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:47.690815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bfa89790-cc8e-485e-b8b3-c78766cded60 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:47.692297 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bfa89790-cc8e-485e-b8b3-c78766cded60 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.271677 May 10 14:00:47.692871 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 54/121] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:47 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:48.204541 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d3b48a8c-7f3f-41b7-99ef-4f1fab58540b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:48.205175 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d3b48a8c-7f3f-41b7-99ef-4f1fab58540b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:48.211938 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d3b48a8c-7f3f-41b7-99ef-4f1fab58540b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:48.212431 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d3b48a8c-7f3f-41b7-99ef-4f1fab58540b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:48.213398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d3b48a8c-7f3f-41b7-99ef-4f1fab58540b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:48.213868 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d3b48a8c-7f3f-41b7-99ef-4f1fab58540b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:48.348990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d3b48a8c-7f3f-41b7-99ef-4f1fab58540b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:48.357397 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d3b48a8c-7f3f-41b7-99ef-4f1fab58540b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.157786 May 10 14:00:48.357756 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 68/122] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:48 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:48.435100 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5f56884f-4296-4de7-b419-653f83d784da tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:48.435710 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-5f56884f-4296-4de7-b419-653f83d784da tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:48.441642 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5f56884f-4296-4de7-b419-653f83d784da tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:48.442273 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5f56884f-4296-4de7-b419-653f83d784da tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:48.452839 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5f56884f-4296-4de7-b419-653f83d784da tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:48.453597 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5f56884f-4296-4de7-b419-653f83d784da tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:48.505939 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-39e050df-cc3d-48dd-87e4-9a20064e077f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:48.506848 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-39e050df-cc3d-48dd-87e4-9a20064e077f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:48.520835 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-39e050df-cc3d-48dd-87e4-9a20064e077f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:48.521324 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-39e050df-cc3d-48dd-87e4-9a20064e077f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:48.522143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-39e050df-cc3d-48dd-87e4-9a20064e077f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:48.522790 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-39e050df-cc3d-48dd-87e4-9a20064e077f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:48.703018 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-5f56884f-4296-4de7-b419-653f83d784da tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:48.739931 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-5f56884f-4296-4de7-b419-653f83d784da tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.308967 May 10 14:00:48.743675 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 55/123] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:48 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:48.758131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fdfd00af-431c-4eda-b192-a0347252cd70 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:48.758752 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fdfd00af-431c-4eda-b192-a0347252cd70 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:48.783731 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fdfd00af-431c-4eda-b192-a0347252cd70 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:48.784202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fdfd00af-431c-4eda-b192-a0347252cd70 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:48.785196 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fdfd00af-431c-4eda-b192-a0347252cd70 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:48.786859 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fdfd00af-431c-4eda-b192-a0347252cd70 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:49.032517 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-fdfd00af-431c-4eda-b192-a0347252cd70 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:49.040934 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-fdfd00af-431c-4eda-b192-a0347252cd70 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:49.042451 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-fdfd00af-431c-4eda-b192-a0347252cd70 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:49.044156 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fdfd00af-431c-4eda-b192-a0347252cd70 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.297884 May 10 14:00:49.048546 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 56/124] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:48 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:49.172328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-39e050df-cc3d-48dd-87e4-9a20064e077f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:49.180106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-39e050df-cc3d-48dd-87e4-9a20064e077f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.680646 May 10 14:00:49.188768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 69/125] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:48 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:49.374163 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-82e84977-a3fc-4417-87a3-ddafe0a799a9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:49.375085 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-82e84977-a3fc-4417-87a3-ddafe0a799a9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:49.387350 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82e84977-a3fc-4417-87a3-ddafe0a799a9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:49.387829 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82e84977-a3fc-4417-87a3-ddafe0a799a9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:49.388629 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82e84977-a3fc-4417-87a3-ddafe0a799a9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:49.389268 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82e84977-a3fc-4417-87a3-ddafe0a799a9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:49.548957 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-82e84977-a3fc-4417-87a3-ddafe0a799a9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:49.562804 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-82e84977-a3fc-4417-87a3-ddafe0a799a9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.192843 May 10 14:00:49.563389 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 57/126] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:49 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:49.759915 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c9f0951a-2dad-4387-920d-23ff1a70108d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:49.760649 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c9f0951a-2dad-4387-920d-23ff1a70108d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:49.767048 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c9f0951a-2dad-4387-920d-23ff1a70108d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:49.767819 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c9f0951a-2dad-4387-920d-23ff1a70108d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:49.768837 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c9f0951a-2dad-4387-920d-23ff1a70108d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:49.769483 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c9f0951a-2dad-4387-920d-23ff1a70108d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:49.934581 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c9f0951a-2dad-4387-920d-23ff1a70108d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:49.944914 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c9f0951a-2dad-4387-920d-23ff1a70108d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.188761 May 10 14:00:49.946004 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 70/127] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:49 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:50.065365 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7505b558-e568-4531-a169-18a458f87837 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:50.066060 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7505b558-e568-4531-a169-18a458f87837 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:50.072452 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7505b558-e568-4531-a169-18a458f87837 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:50.072930 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7505b558-e568-4531-a169-18a458f87837 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:50.073704 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7505b558-e568-4531-a169-18a458f87837 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:50.074678 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7505b558-e568-4531-a169-18a458f87837 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:50.196350 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-45806a9c-c21b-4468-9f8b-d0070a306263 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:50.197339 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-45806a9c-c21b-4468-9f8b-d0070a306263 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:50.203693 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-45806a9c-c21b-4468-9f8b-d0070a306263 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:50.204489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-45806a9c-c21b-4468-9f8b-d0070a306263 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:50.205549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-45806a9c-c21b-4468-9f8b-d0070a306263 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:50.206192 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-45806a9c-c21b-4468-9f8b-d0070a306263 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:50.210585 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7505b558-e568-4531-a169-18a458f87837 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:50.218500 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7505b558-e568-4531-a169-18a458f87837 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:50.220758 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7505b558-e568-4531-a169-18a458f87837 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:50.221915 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7505b558-e568-4531-a169-18a458f87837 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1406 microversion: 2.20 time: 0.160805 May 10 14:00:50.232908 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 58/128] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:50 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:50.369476 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-45806a9c-c21b-4468-9f8b-d0070a306263 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:50.379310 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-45806a9c-c21b-4468-9f8b-d0070a306263 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1364 microversion: 2.1 time: 0.186891 May 10 14:00:50.389731 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 71/129] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:50 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:50.580736 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d29d2213-65a9-4266-9300-bdbbf1f903f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:50.581821 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d29d2213-65a9-4266-9300-bdbbf1f903f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:50.594471 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d29d2213-65a9-4266-9300-bdbbf1f903f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:50.594932 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d29d2213-65a9-4266-9300-bdbbf1f903f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:50.595730 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d29d2213-65a9-4266-9300-bdbbf1f903f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:50.600644 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d29d2213-65a9-4266-9300-bdbbf1f903f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:50.769599 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d29d2213-65a9-4266-9300-bdbbf1f903f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:50.781691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d29d2213-65a9-4266-9300-bdbbf1f903f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.206297 May 10 14:00:50.783003 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 59/130] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:50 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:50.795104 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-8ddcdaa5-f1a0-4fc3-b473-20a7aacac3c4 req-49c8325e-9020-4d61-82f6-761175cb0d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e5f6640-8318-4ba7-be1f-7a578b595363", "name": "network-vif-plugged", "status": "completed", "tag": "11a4481d-f88f-4503-b4d7-f6b62b846773"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:50.804293 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-8ddcdaa5-f1a0-4fc3-b473-20a7aacac3c4 req-49c8325e-9020-4d61-82f6-761175cb0d47 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:50.805084 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-8ddcdaa5-f1a0-4fc3-b473-20a7aacac3c4 req-49c8325e-9020-4d61-82f6-761175cb0d47 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:50.830276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-8ddcdaa5-f1a0-4fc3-b473-20a7aacac3c4 req-49c8325e-9020-4d61-82f6-761175cb0d47 service nova] Creating event network-vif-plugged:11a4481d-f88f-4503-b4d7-f6b62b846773 for instance 1e5f6640-8318-4ba7-be1f-7a578b595363 on hv-cinder-84067 May 10 14:00:50.835361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-8ddcdaa5-f1a0-4fc3-b473-20a7aacac3c4 req-49c8325e-9020-4d61-82f6-761175cb0d47 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045386 May 10 14:00:50.836591 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 72/131] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:50.962364 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c9367f74-d645-488b-8f0d-07463735085d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:50.963429 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c9367f74-d645-488b-8f0d-07463735085d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:50.973498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9367f74-d645-488b-8f0d-07463735085d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:50.974748 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9367f74-d645-488b-8f0d-07463735085d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:50.976051 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9367f74-d645-488b-8f0d-07463735085d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:50.976671 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9367f74-d645-488b-8f0d-07463735085d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:51.209739 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c9367f74-d645-488b-8f0d-07463735085d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:51.221455 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c9367f74-d645-488b-8f0d-07463735085d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.262978 May 10 14:00:51.222058 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 60/132] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:50 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:51.242097 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-70aaea6d-3006-49ca-a080-988839740072 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:51.243173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-70aaea6d-3006-49ca-a080-988839740072 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:51.252333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-70aaea6d-3006-49ca-a080-988839740072 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:51.253008 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-70aaea6d-3006-49ca-a080-988839740072 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:51.254075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-70aaea6d-3006-49ca-a080-988839740072 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:51.254659 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-70aaea6d-3006-49ca-a080-988839740072 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:51.396045 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2175dfc2-12d0-47a1-b751-420c2ef71f7d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:51.396370 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2175dfc2-12d0-47a1-b751-420c2ef71f7d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:51.404026 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2175dfc2-12d0-47a1-b751-420c2ef71f7d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:51.405020 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2175dfc2-12d0-47a1-b751-420c2ef71f7d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:51.405879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2175dfc2-12d0-47a1-b751-420c2ef71f7d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:51.406512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2175dfc2-12d0-47a1-b751-420c2ef71f7d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:51.434640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-70aaea6d-3006-49ca-a080-988839740072 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:51.446834 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-70aaea6d-3006-49ca-a080-988839740072 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:51.448363 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-70aaea6d-3006-49ca-a080-988839740072 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:51.450093 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-70aaea6d-3006-49ca-a080-988839740072 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1597 microversion: 2.20 time: 0.212812 May 10 14:00:51.450651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 73/133] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:00:51 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1597 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:51.469627 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-968c481b-0137-428e-9597-7d7224c85145 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:51.470425 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-968c481b-0137-428e-9597-7d7224c85145 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:51.476616 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-968c481b-0137-428e-9597-7d7224c85145 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:51.477354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-968c481b-0137-428e-9597-7d7224c85145 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:51.478360 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-968c481b-0137-428e-9597-7d7224c85145 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:51.479016 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-968c481b-0137-428e-9597-7d7224c85145 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:51.549054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2175dfc2-12d0-47a1-b751-420c2ef71f7d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:51.557129 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2175dfc2-12d0-47a1-b751-420c2ef71f7d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1549 microversion: 2.1 time: 0.165105 May 10 14:00:51.557789 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 61/134] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:51 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:51.576520 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c3fdc7f4-01c9-4d3d-a081-7ed1b02ab7b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:51.577083 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c3fdc7f4-01c9-4d3d-a081-7ed1b02ab7b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:51.583550 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c3fdc7f4-01c9-4d3d-a081-7ed1b02ab7b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:51.584929 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c3fdc7f4-01c9-4d3d-a081-7ed1b02ab7b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:51.585578 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c3fdc7f4-01c9-4d3d-a081-7ed1b02ab7b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:51.586018 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c3fdc7f4-01c9-4d3d-a081-7ed1b02ab7b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:51.590241 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-968c481b-0137-428e-9597-7d7224c85145 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.123910 May 10 14:00:51.596521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 74/135] 10.222.0.49 () {60 vars in 1315 bytes} [Tue May 10 14:00:51 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:00:51.799220 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ca013937-6a47-4c39-846c-bb515883e49e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:51.799881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ca013937-6a47-4c39-846c-bb515883e49e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:51.818353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ca013937-6a47-4c39-846c-bb515883e49e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:51.818803 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ca013937-6a47-4c39-846c-bb515883e49e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:51.819588 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ca013937-6a47-4c39-846c-bb515883e49e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:51.820022 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ca013937-6a47-4c39-846c-bb515883e49e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:51.848407 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c3fdc7f4-01c9-4d3d-a081-7ed1b02ab7b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.276613 May 10 14:00:51.849191 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 62/136] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 14:00:51 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/os-interface => generated 284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:00:52.239433 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9ce71b86-5a82-4b39-8b1d-c00074caec7f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:52.240184 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9ce71b86-5a82-4b39-8b1d-c00074caec7f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:52.248627 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9ce71b86-5a82-4b39-8b1d-c00074caec7f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:52.249437 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9ce71b86-5a82-4b39-8b1d-c00074caec7f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:52.250582 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9ce71b86-5a82-4b39-8b1d-c00074caec7f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:52.251386 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9ce71b86-5a82-4b39-8b1d-c00074caec7f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:52.252632 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ca013937-6a47-4c39-846c-bb515883e49e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:52.269198 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ca013937-6a47-4c39-846c-bb515883e49e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.473601 May 10 14:00:52.270948 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 75/137] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:51 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:52.744954 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9ce71b86-5a82-4b39-8b1d-c00074caec7f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:52.757412 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9ce71b86-5a82-4b39-8b1d-c00074caec7f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.519240 May 10 14:00:52.757412 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 63/138] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:52 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:52.855985 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-4232444f-f9e6-4b51-8b1c-20e9a9c69e91 req-67eebf73-8f09-4b48-86cc-88e7c1ad27f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99093de-3e49-4cee-b398-90c326ef8050", "name": "network-vif-plugged", "status": "completed", "tag": "0f558f56-6f77-4669-b4bd-6cfd29789243"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:52.865908 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-4232444f-f9e6-4b51-8b1c-20e9a9c69e91 req-67eebf73-8f09-4b48-86cc-88e7c1ad27f0 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:52.866644 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-4232444f-f9e6-4b51-8b1c-20e9a9c69e91 req-67eebf73-8f09-4b48-86cc-88e7c1ad27f0 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:52.883449 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-4232444f-f9e6-4b51-8b1c-20e9a9c69e91 req-67eebf73-8f09-4b48-86cc-88e7c1ad27f0 service nova] Creating event network-vif-plugged:0f558f56-6f77-4669-b4bd-6cfd29789243 for instance c99093de-3e49-4cee-b398-90c326ef8050 on hv-cinder-84067 May 10 14:00:52.889686 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-4232444f-f9e6-4b51-8b1c-20e9a9c69e91 req-67eebf73-8f09-4b48-86cc-88e7c1ad27f0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037097 May 10 14:00:52.895099 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 76/139] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:53.288163 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-373f2289-9a44-44a7-ad86-88cddfb593b5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:53.288952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-373f2289-9a44-44a7-ad86-88cddfb593b5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:53.296524 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-373f2289-9a44-44a7-ad86-88cddfb593b5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:53.297251 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-373f2289-9a44-44a7-ad86-88cddfb593b5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:53.298192 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-373f2289-9a44-44a7-ad86-88cddfb593b5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:53.298783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-373f2289-9a44-44a7-ad86-88cddfb593b5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:53.550355 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-373f2289-9a44-44a7-ad86-88cddfb593b5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:53.565120 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-373f2289-9a44-44a7-ad86-88cddfb593b5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.280753 May 10 14:00:53.566062 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 64/140] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:53 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:53.689273 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-873c2305-1e59-44e1-8200-1714a2d771c8 req-07279fc8-c4c9-4114-ac73-49579f6e8221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067bd8aa-a9d7-41f4-82a3-54e00fe64f68", "tag": "0b32a17e-9e2f-475d-abe1-8b69acb4c76a"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:53.710266 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-089f2e77-3b34-40b5-847d-a2cbe3cb0326 req-8cae675e-7019-4037-a2a6-bacddb68839c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22e54ed-bbfa-42df-af34-67721740c4b0", "tag": "48a907c3-b5e2-4fd8-b6cb-cc60b528bc16"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:53.712838 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-873c2305-1e59-44e1-8200-1714a2d771c8 req-07279fc8-c4c9-4114-ac73-49579f6e8221 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:53.717357 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-873c2305-1e59-44e1-8200-1714a2d771c8 req-07279fc8-c4c9-4114-ac73-49579f6e8221 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:53.729556 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-873c2305-1e59-44e1-8200-1714a2d771c8 req-07279fc8-c4c9-4114-ac73-49579f6e8221 service nova] Creating event network-changed:0b32a17e-9e2f-475d-abe1-8b69acb4c76a for instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 on hv-cinder-84067 May 10 14:00:53.734783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-089f2e77-3b34-40b5-847d-a2cbe3cb0326 req-8cae675e-7019-4037-a2a6-bacddb68839c service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:53.735491 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-089f2e77-3b34-40b5-847d-a2cbe3cb0326 req-8cae675e-7019-4037-a2a6-bacddb68839c service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:53.744195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-873c2305-1e59-44e1-8200-1714a2d771c8 req-07279fc8-c4c9-4114-ac73-49579f6e8221 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065218 May 10 14:00:53.748518 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 77/141] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:53.756398 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-089f2e77-3b34-40b5-847d-a2cbe3cb0326 req-8cae675e-7019-4037-a2a6-bacddb68839c service nova] Creating event network-changed:48a907c3-b5e2-4fd8-b6cb-cc60b528bc16 for instance c22e54ed-bbfa-42df-af34-67721740c4b0 on hv-cinder-84067 May 10 14:00:53.763889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-089f2e77-3b34-40b5-847d-a2cbe3cb0326 req-8cae675e-7019-4037-a2a6-bacddb68839c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056850 May 10 14:00:53.765118 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 65/142] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:00:53.780661 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-92e03a3c-552d-45fb-ab1f-4a0687e68b9c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:53.780879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-92e03a3c-552d-45fb-ab1f-4a0687e68b9c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:53.790763 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-92e03a3c-552d-45fb-ab1f-4a0687e68b9c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:53.791216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-92e03a3c-552d-45fb-ab1f-4a0687e68b9c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:53.791994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-92e03a3c-552d-45fb-ab1f-4a0687e68b9c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:53.795739 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-92e03a3c-552d-45fb-ab1f-4a0687e68b9c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:53.953527 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-92e03a3c-552d-45fb-ab1f-4a0687e68b9c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:53.963763 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-92e03a3c-552d-45fb-ab1f-4a0687e68b9c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.186598 May 10 14:00:53.964810 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 78/143] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:53 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:54.582987 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-27c2e551-d0e2-4cfe-8406-d76e9fd09e56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:54.583942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-27c2e551-d0e2-4cfe-8406-d76e9fd09e56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:54.601092 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-27c2e551-d0e2-4cfe-8406-d76e9fd09e56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:54.601846 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-27c2e551-d0e2-4cfe-8406-d76e9fd09e56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:54.604413 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-27c2e551-d0e2-4cfe-8406-d76e9fd09e56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:54.609179 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-27c2e551-d0e2-4cfe-8406-d76e9fd09e56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:54.968020 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-27c2e551-d0e2-4cfe-8406-d76e9fd09e56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:54.976021 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-27c2e551-d0e2-4cfe-8406-d76e9fd09e56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.397108 May 10 14:00:54.976895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 66/144] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:54 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:54.981103 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-75d84355-7012-4cc8-af19-785eaa981b49 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:54.981720 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-75d84355-7012-4cc8-af19-785eaa981b49 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:54.988513 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-75d84355-7012-4cc8-af19-785eaa981b49 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:54.988982 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-75d84355-7012-4cc8-af19-785eaa981b49 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:54.989896 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-75d84355-7012-4cc8-af19-785eaa981b49 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:54.990333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-75d84355-7012-4cc8-af19-785eaa981b49 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:55.204013 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-75d84355-7012-4cc8-af19-785eaa981b49 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:55.223820 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-75d84355-7012-4cc8-af19-785eaa981b49 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.246627 May 10 14:00:55.224798 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 79/145] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:54 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:00:55.993847 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-83f9b17a-c38b-4d44-bd26-7e3914c40459 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:55.994474 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-83f9b17a-c38b-4d44-bd26-7e3914c40459 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:56.006744 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-83f9b17a-c38b-4d44-bd26-7e3914c40459 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:56.008973 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-83f9b17a-c38b-4d44-bd26-7e3914c40459 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:56.012949 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-83f9b17a-c38b-4d44-bd26-7e3914c40459 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:56.013588 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-83f9b17a-c38b-4d44-bd26-7e3914c40459 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:56.119573 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-dc74ba7e-7a03-4ba4-aed8-0e01de92ac05 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:56.120095 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-dc74ba7e-7a03-4ba4-aed8-0e01de92ac05 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:56.136482 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-dc74ba7e-7a03-4ba4-aed8-0e01de92ac05 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:56.136856 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-dc74ba7e-7a03-4ba4-aed8-0e01de92ac05 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:56.137654 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-dc74ba7e-7a03-4ba4-aed8-0e01de92ac05 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:56.138098 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-dc74ba7e-7a03-4ba4-aed8-0e01de92ac05 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:56.172182 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-dc74ba7e-7a03-4ba4-aed8-0e01de92ac05 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Going to try to terminate instance {{(pid=117154) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:00:56.270729 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-dc74ba7e-7a03-4ba4-aed8-0e01de92ac05 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "DELETE /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 204 len: 0 microversion: 2.1 time: 0.155560 May 10 14:00:56.274540 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 80/146] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:00:56 2022] DELETE /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:00:56.278323 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-89e81f6b-88af-4476-b74e-220c9949ac5a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:56.279035 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-89e81f6b-88af-4476-b74e-220c9949ac5a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:56.286965 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89e81f6b-88af-4476-b74e-220c9949ac5a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:56.287494 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89e81f6b-88af-4476-b74e-220c9949ac5a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:56.288311 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89e81f6b-88af-4476-b74e-220c9949ac5a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:56.288758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89e81f6b-88af-4476-b74e-220c9949ac5a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:56.314846 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-83f9b17a-c38b-4d44-bd26-7e3914c40459 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:56.322229 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-83f9b17a-c38b-4d44-bd26-7e3914c40459 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.333246 May 10 14:00:56.322811 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 67/147] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:55 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:56.327445 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-315a7b94-c828-4538-bfec-601c0782d6ab tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:56.328051 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-315a7b94-c828-4538-bfec-601c0782d6ab tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:56.333818 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-315a7b94-c828-4538-bfec-601c0782d6ab tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:56.334284 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-315a7b94-c828-4538-bfec-601c0782d6ab tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:56.335306 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-315a7b94-c828-4538-bfec-601c0782d6ab tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:56.335823 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-315a7b94-c828-4538-bfec-601c0782d6ab tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:56.439382 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-89e81f6b-88af-4476-b74e-220c9949ac5a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:56.447107 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-89e81f6b-88af-4476-b74e-220c9949ac5a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1365 microversion: 2.1 time: 0.174057 May 10 14:00:56.447944 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 81/148] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:56 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:56.515188 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-315a7b94-c828-4538-bfec-601c0782d6ab tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:56.523334 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-315a7b94-c828-4538-bfec-601c0782d6ab tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1554 microversion: 2.1 time: 0.199112 May 10 14:00:56.523905 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 68/149] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:56 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:57.339016 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-fbc16e90-c34b-451d-8648-4759c99d658b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:57.340212 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-fbc16e90-c34b-451d-8648-4759c99d658b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:57.347858 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fbc16e90-c34b-451d-8648-4759c99d658b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:57.348481 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fbc16e90-c34b-451d-8648-4759c99d658b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:57.349643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fbc16e90-c34b-451d-8648-4759c99d658b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:57.350259 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fbc16e90-c34b-451d-8648-4759c99d658b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:57.464782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-eb627336-4643-4a69-a48f-afc0609b9980 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:57.465328 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-eb627336-4643-4a69-a48f-afc0609b9980 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:57.471340 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-eb627336-4643-4a69-a48f-afc0609b9980 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:57.471801 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-eb627336-4643-4a69-a48f-afc0609b9980 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:57.472626 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-eb627336-4643-4a69-a48f-afc0609b9980 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:57.473069 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-eb627336-4643-4a69-a48f-afc0609b9980 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:57.488930 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-fbc16e90-c34b-451d-8648-4759c99d658b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:57.498243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-fbc16e90-c34b-451d-8648-4759c99d658b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.163343 May 10 14:00:57.508227 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 82/150] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:57 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:57.541086 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5a3686c7-62b4-4f0b-9fb8-72b00e0f2078 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:57.541796 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5a3686c7-62b4-4f0b-9fb8-72b00e0f2078 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:57.547797 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5a3686c7-62b4-4f0b-9fb8-72b00e0f2078 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:57.548525 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5a3686c7-62b4-4f0b-9fb8-72b00e0f2078 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:57.549489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5a3686c7-62b4-4f0b-9fb8-72b00e0f2078 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:57.549931 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5a3686c7-62b4-4f0b-9fb8-72b00e0f2078 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:57.609399 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-eb627336-4643-4a69-a48f-afc0609b9980 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:57.617296 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-eb627336-4643-4a69-a48f-afc0609b9980 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1555 microversion: 2.1 time: 0.156832 May 10 14:00:57.618359 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 69/151] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:57 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:57.635242 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3aa7066f-5007-4ea0-aa2e-7fe8179f6ba5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:57.635735 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-3aa7066f-5007-4ea0-aa2e-7fe8179f6ba5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:57.642306 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3aa7066f-5007-4ea0-aa2e-7fe8179f6ba5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:57.642771 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3aa7066f-5007-4ea0-aa2e-7fe8179f6ba5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:57.643530 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3aa7066f-5007-4ea0-aa2e-7fe8179f6ba5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:57.643972 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3aa7066f-5007-4ea0-aa2e-7fe8179f6ba5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:57.691926 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5a3686c7-62b4-4f0b-9fb8-72b00e0f2078 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:57.701469 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5a3686c7-62b4-4f0b-9fb8-72b00e0f2078 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1554 microversion: 2.1 time: 0.164006 May 10 14:00:57.702335 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 83/152] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:57 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:57.723282 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3aa7066f-5007-4ea0-aa2e-7fe8179f6ba5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091803 May 10 14:00:57.723953 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 70/153] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 14:00:57 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:00:58.515138 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d106d701-8942-45fb-a348-2ff00488f2f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:58.516368 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d106d701-8942-45fb-a348-2ff00488f2f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:58.522221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d106d701-8942-45fb-a348-2ff00488f2f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:58.523153 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d106d701-8942-45fb-a348-2ff00488f2f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:58.524100 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d106d701-8942-45fb-a348-2ff00488f2f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:58.524742 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d106d701-8942-45fb-a348-2ff00488f2f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:58.661840 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d106d701-8942-45fb-a348-2ff00488f2f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:58.670060 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d106d701-8942-45fb-a348-2ff00488f2f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.159149 May 10 14:00:58.670632 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 84/154] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:58 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:58.725940 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f1d7cded-2508-4057-a677-eb1ac9d4ceb9 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:58.729258 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f1d7cded-2508-4057-a677-eb1ac9d4ceb9 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:58.741634 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f1d7cded-2508-4057-a677-eb1ac9d4ceb9 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:58.743460 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f1d7cded-2508-4057-a677-eb1ac9d4ceb9 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:58.745028 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f1d7cded-2508-4057-a677-eb1ac9d4ceb9 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:58.745597 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f1d7cded-2508-4057-a677-eb1ac9d4ceb9 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:59.009389 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-ef80c036-f40c-4997-ae00-be24ff38b398 req-211a53a5-a5e7-4807-962c-671070448998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e5f6640-8318-4ba7-be1f-7a578b595363", "tag": "11a4481d-f88f-4503-b4d7-f6b62b846773"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:00:59.020199 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-ef80c036-f40c-4997-ae00-be24ff38b398 req-211a53a5-a5e7-4807-962c-671070448998 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:59.020895 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-ef80c036-f40c-4997-ae00-be24ff38b398 req-211a53a5-a5e7-4807-962c-671070448998 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:59.033774 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-ef80c036-f40c-4997-ae00-be24ff38b398 req-211a53a5-a5e7-4807-962c-671070448998 service nova] Creating event network-changed:11a4481d-f88f-4503-b4d7-f6b62b846773 for instance 1e5f6640-8318-4ba7-be1f-7a578b595363 on hv-cinder-84067 May 10 14:00:59.041199 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-ef80c036-f40c-4997-ae00-be24ff38b398 req-211a53a5-a5e7-4807-962c-671070448998 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038024 May 10 14:00:59.042078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 85/155] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:00:59.065533 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f1d7cded-2508-4057-a677-eb1ac9d4ceb9 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:59.073179 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f1d7cded-2508-4057-a677-eb1ac9d4ceb9 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1554 microversion: 2.1 time: 0.357601 May 10 14:00:59.074296 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 71/156] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:58 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1554 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:00:59.688274 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8686603b-6880-4983-bb51-84ea73816545 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:00:59.689135 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8686603b-6880-4983-bb51-84ea73816545 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:00:59.696625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8686603b-6880-4983-bb51-84ea73816545 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:59.697461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8686603b-6880-4983-bb51-84ea73816545 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:59.698262 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8686603b-6880-4983-bb51-84ea73816545 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:59.698891 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8686603b-6880-4983-bb51-84ea73816545 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:59.899412 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8686603b-6880-4983-bb51-84ea73816545 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:00:59.908691 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8686603b-6880-4983-bb51-84ea73816545 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.225493 May 10 14:00:59.909276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 86/157] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:00:59 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:00.091215 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-245ca330-88ed-4d37-af65-db7dbc97f12c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:00.091858 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-245ca330-88ed-4d37-af65-db7dbc97f12c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:00.097943 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-245ca330-88ed-4d37-af65-db7dbc97f12c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:00.098392 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-245ca330-88ed-4d37-af65-db7dbc97f12c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:00.099159 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-245ca330-88ed-4d37-af65-db7dbc97f12c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:00.099594 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-245ca330-88ed-4d37-af65-db7dbc97f12c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:00.231647 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-245ca330-88ed-4d37-af65-db7dbc97f12c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:00.240513 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-245ca330-88ed-4d37-af65-db7dbc97f12c tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1554 microversion: 2.1 time: 0.153419 May 10 14:01:00.241044 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 72/158] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:00 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:00.925893 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-28f0d940-d9b1-4388-ba83-50ffee8f76f2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:00.926506 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-28f0d940-d9b1-4388-ba83-50ffee8f76f2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:00.932514 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28f0d940-d9b1-4388-ba83-50ffee8f76f2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:00.933481 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28f0d940-d9b1-4388-ba83-50ffee8f76f2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:00.934242 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28f0d940-d9b1-4388-ba83-50ffee8f76f2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:00.934684 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28f0d940-d9b1-4388-ba83-50ffee8f76f2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:01.068261 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-28f0d940-d9b1-4388-ba83-50ffee8f76f2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:01.075537 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-28f0d940-d9b1-4388-ba83-50ffee8f76f2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1322 microversion: 2.1 time: 0.153353 May 10 14:01:01.076320 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 87/159] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:00 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:01.257319 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-33c2e61e-c779-4c5b-8e53-0355e2400210 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:01.257931 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-33c2e61e-c779-4c5b-8e53-0355e2400210 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:01.263808 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-33c2e61e-c779-4c5b-8e53-0355e2400210 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:01.264299 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-33c2e61e-c779-4c5b-8e53-0355e2400210 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:01.265071 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-33c2e61e-c779-4c5b-8e53-0355e2400210 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:01.265508 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-33c2e61e-c779-4c5b-8e53-0355e2400210 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:01.403874 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-33c2e61e-c779-4c5b-8e53-0355e2400210 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:01.411651 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-33c2e61e-c779-4c5b-8e53-0355e2400210 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1554 microversion: 2.1 time: 0.158123 May 10 14:01:01.412565 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 73/160] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:01 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:02.093145 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8004cb2a-b704-4fd8-a3b5-1e6f14039fc2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:02.093748 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8004cb2a-b704-4fd8-a3b5-1e6f14039fc2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:02.100630 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8004cb2a-b704-4fd8-a3b5-1e6f14039fc2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:02.101337 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8004cb2a-b704-4fd8-a3b5-1e6f14039fc2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:02.102227 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8004cb2a-b704-4fd8-a3b5-1e6f14039fc2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:02.102801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8004cb2a-b704-4fd8-a3b5-1e6f14039fc2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:02.242870 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8004cb2a-b704-4fd8-a3b5-1e6f14039fc2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:02.251571 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8004cb2a-b704-4fd8-a3b5-1e6f14039fc2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1515 microversion: 2.1 time: 0.161766 May 10 14:01:02.252799 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 88/161] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:02 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:02.270217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fefae0d5-3e58-4cac-b976-354553c34693 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:02.271337 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fefae0d5-3e58-4cac-b976-354553c34693 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:02.277920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fefae0d5-3e58-4cac-b976-354553c34693 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:02.278373 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fefae0d5-3e58-4cac-b976-354553c34693 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:02.279155 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fefae0d5-3e58-4cac-b976-354553c34693 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:02.279605 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fefae0d5-3e58-4cac-b976-354553c34693 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:02.305122 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-fefae0d5-3e58-4cac-b976-354553c34693 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lazy-loading 'flavor' on Instance uuid c99093de-3e49-4cee-b398-90c326ef8050 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:01:02.430770 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2c039e80-b0bd-4985-af6b-330fd2cc039f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:02.432000 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2c039e80-b0bd-4985-af6b-330fd2cc039f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:02.441552 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2c039e80-b0bd-4985-af6b-330fd2cc039f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:02.442404 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2c039e80-b0bd-4985-af6b-330fd2cc039f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:02.443385 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2c039e80-b0bd-4985-af6b-330fd2cc039f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:02.444092 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2c039e80-b0bd-4985-af6b-330fd2cc039f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:02.453610 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fefae0d5-3e58-4cac-b976-354553c34693 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "POST /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050/action" status: 200 len: 32 microversion: 2.1 time: 0.182793 May 10 14:01:02.458486 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 74/162] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:01:02 2022] POST /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:01:02.464508 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-cbc5ad5c-b28b-4c32-9b47-638ab1d55001 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:02.466233 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-cbc5ad5c-b28b-4c32-9b47-638ab1d55001 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:02.473894 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cbc5ad5c-b28b-4c32-9b47-638ab1d55001 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:02.474447 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cbc5ad5c-b28b-4c32-9b47-638ab1d55001 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:02.475748 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cbc5ad5c-b28b-4c32-9b47-638ab1d55001 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:02.476468 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cbc5ad5c-b28b-4c32-9b47-638ab1d55001 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:02.607616 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2c039e80-b0bd-4985-af6b-330fd2cc039f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:02.617559 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2c039e80-b0bd-4985-af6b-330fd2cc039f tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1554 microversion: 2.1 time: 0.192042 May 10 14:01:02.618515 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 89/163] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:02 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:02.648017 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-cbc5ad5c-b28b-4c32-9b47-638ab1d55001 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:02.656455 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-cbc5ad5c-b28b-4c32-9b47-638ab1d55001 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.196252 May 10 14:01:02.657067 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 75/164] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:02 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:03.635539 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3c6bed56-a40f-4196-8aba-9cab0879f852 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:03.636778 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3c6bed56-a40f-4196-8aba-9cab0879f852 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:03.643561 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3c6bed56-a40f-4196-8aba-9cab0879f852 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:03.657377 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3c6bed56-a40f-4196-8aba-9cab0879f852 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:03.658559 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3c6bed56-a40f-4196-8aba-9cab0879f852 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:03.659176 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3c6bed56-a40f-4196-8aba-9cab0879f852 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:03.674537 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8cd71125-649a-40fe-b372-f0511d14b2ce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:03.675890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8cd71125-649a-40fe-b372-f0511d14b2ce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:03.687248 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8cd71125-649a-40fe-b372-f0511d14b2ce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:03.687899 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8cd71125-649a-40fe-b372-f0511d14b2ce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:03.689953 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8cd71125-649a-40fe-b372-f0511d14b2ce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:03.695873 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8cd71125-649a-40fe-b372-f0511d14b2ce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:03.950576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3c6bed56-a40f-4196-8aba-9cab0879f852 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:03.959618 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3c6bed56-a40f-4196-8aba-9cab0879f852 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1554 microversion: 2.1 time: 0.328294 May 10 14:01:03.960541 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 90/165] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:03 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1554 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:04.109614 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8cd71125-649a-40fe-b372-f0511d14b2ce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:04.119070 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8cd71125-649a-40fe-b372-f0511d14b2ce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.448760 May 10 14:01:04.120830 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 76/166] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:03 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:04.364070 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-ec92db0d-e170-432e-9e4c-5ef5632e791b req-bb834452-7eae-4b12-8200-e2174f975ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983a758b-f633-43b1-9215-c91fadb59ff6", "name": "network-vif-deleted", "tag": "32493f7b-bc46-42f6-a393-ade265851e55"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:04.380347 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-ec92db0d-e170-432e-9e4c-5ef5632e791b req-bb834452-7eae-4b12-8200-e2174f975ffc service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:04.381255 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-ec92db0d-e170-432e-9e4c-5ef5632e791b req-bb834452-7eae-4b12-8200-e2174f975ffc service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:04.396019 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-ec92db0d-e170-432e-9e4c-5ef5632e791b req-bb834452-7eae-4b12-8200-e2174f975ffc service nova] Creating event network-vif-deleted:32493f7b-bc46-42f6-a393-ade265851e55 for instance 983a758b-f633-43b1-9215-c91fadb59ff6 on hv-cinder-84067 May 10 14:01:04.403803 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-ec92db0d-e170-432e-9e4c-5ef5632e791b req-bb834452-7eae-4b12-8200-e2174f975ffc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042704 May 10 14:01:04.405142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 91/167] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:04.980396 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b820b412-8d7d-4e37-8c69-008cbc4e09d8 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:04.981273 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b820b412-8d7d-4e37-8c69-008cbc4e09d8 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:04.996026 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b820b412-8d7d-4e37-8c69-008cbc4e09d8 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:04.997231 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b820b412-8d7d-4e37-8c69-008cbc4e09d8 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:04.998173 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b820b412-8d7d-4e37-8c69-008cbc4e09d8 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:04.998755 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b820b412-8d7d-4e37-8c69-008cbc4e09d8 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:05.123192 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b820b412-8d7d-4e37-8c69-008cbc4e09d8 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2218b6609f344dc94f91247e8504e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854eb7b7a9a44ca283e9c95ce935624d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:05.136755 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b820b412-8d7d-4e37-8c69-008cbc4e09d8 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 200 len: 1346 microversion: 2.1 time: 0.160150 May 10 14:01:05.137478 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 77/168] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:04 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 1346 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:05.146154 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-df54143a-dda9-48db-a6bc-64dc9e2b04db tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:05.146154 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-df54143a-dda9-48db-a6bc-64dc9e2b04db tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:05.150466 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-df54143a-dda9-48db-a6bc-64dc9e2b04db tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:05.156795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-df54143a-dda9-48db-a6bc-64dc9e2b04db tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:05.157619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-df54143a-dda9-48db-a6bc-64dc9e2b04db tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:05.158073 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-df54143a-dda9-48db-a6bc-64dc9e2b04db tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:05.374081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-df54143a-dda9-48db-a6bc-64dc9e2b04db tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:05.395153 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-df54143a-dda9-48db-a6bc-64dc9e2b04db tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.261766 May 10 14:01:05.396021 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 92/169] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:05 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:06.153986 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f011c15b-bea0-41b6-8cd3-9e645366f2c5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:06.154824 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f011c15b-bea0-41b6-8cd3-9e645366f2c5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:06.161088 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f011c15b-bea0-41b6-8cd3-9e645366f2c5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:06.161771 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f011c15b-bea0-41b6-8cd3-9e645366f2c5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:06.162641 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f011c15b-bea0-41b6-8cd3-9e645366f2c5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:06.163161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f011c15b-bea0-41b6-8cd3-9e645366f2c5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:06.176593 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-f011c15b-bea0-41b6-8cd3-9e645366f2c5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] HTTP exception thrown: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f011c15b-bea0-41b6-8cd3-9e645366f2c5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Request method failure captured: May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 HTTP/1.1 May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_b23gRdShku8eR4JWSACwESDyr9ldCAsH18qLEq5IOBuK-0ejwFrxuosatCC79WW4Kt9Y1t2MXaz5NOS3YQElmSHJgSie6OlKjCGlZf_WnX7sA_QTUEppYevSecs8MrNBvHol-PtG5gksMLGWcn8ldqb1gQvtoPSm5zyoDhTgNLes May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 854eb7b7a9a44ca283e9c95ce935624d May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-DeleteServersTestJSON-1958402780 May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:01:06.181615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:01:06.183652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:01:06.183652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-DeleteServersTestJSON-1958402780 May 10 14:01:06.183652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 854eb7b7a9a44ca283e9c95ce935624d May 10 14:01:06.183652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-DeleteServersTestJSON-1958402780 May 10 14:01:06.183652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-DeleteServersTestJSON-1958402780-project May 10 14:01:06.183652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:01:06.183652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:01:06.183652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: e2218b6609f344dc94f91247e8504e85 May 10 14:01:06.183652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-DeleteServersTestJSON-1958402780-project May 10 14:01:06.183652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:01:06.183652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:06.183652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '983a758b-f633-43b1-9215-c91fadb59ff6'} May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:01:06.184555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:06.185866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:01:06.187061 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f011c15b-bea0-41b6-8cd3-9e645366f2c5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Returning 404 to user: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:01:06.187061 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f011c15b-bea0-41b6-8cd3-9e645366f2c5 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 404 len: 111 microversion: 2.1 time: 0.034966 May 10 14:01:06.187061 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 78/170] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:06 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:01:06.321968 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-de243dd5-7e55-4fc2-a334-d4c4b45cae8b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:06.323035 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-de243dd5-7e55-4fc2-a334-d4c4b45cae8b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:06.330684 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-de243dd5-7e55-4fc2-a334-d4c4b45cae8b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:06.331431 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-de243dd5-7e55-4fc2-a334-d4c4b45cae8b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:06.332350 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-de243dd5-7e55-4fc2-a334-d4c4b45cae8b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:06.332883 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-de243dd5-7e55-4fc2-a334-d4c4b45cae8b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:06.347775 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-de243dd5-7e55-4fc2-a334-d4c4b45cae8b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] HTTP exception thrown: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-de243dd5-7e55-4fc2-a334-d4c4b45cae8b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Request method failure captured: May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6/os-volume_attachments HTTP/1.1 May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_b23gRdShku8eR4JWSACwESDyr9ldCAsH18qLEq5IOBuK-0ejwFrxuosatCC79WW4Kt9Y1t2MXaz5NOS3YQElmSHJgSie6OlKjCGlZf_WnX7sA_QTUEppYevSecs8MrNBvHol-PtG5gksMLGWcn8ldqb1gQvtoPSm5zyoDhTgNLes May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 854eb7b7a9a44ca283e9c95ce935624d May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-DeleteServersTestJSON-1958402780 May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:01:06.352001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:01:06.353576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:01:06.353576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-DeleteServersTestJSON-1958402780 May 10 14:01:06.353576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 854eb7b7a9a44ca283e9c95ce935624d May 10 14:01:06.353576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-DeleteServersTestJSON-1958402780 May 10 14:01:06.353576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-DeleteServersTestJSON-1958402780-project May 10 14:01:06.353576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:01:06.353576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:01:06.353576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: e2218b6609f344dc94f91247e8504e85 May 10 14:01:06.353576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-DeleteServersTestJSON-1958402780-project May 10 14:01:06.353576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:01:06.353576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:06.353576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'server_id': '983a758b-f633-43b1-9215-c91fadb59ff6'} May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:01:06.354379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:06.356208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:01:06.358739 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-de243dd5-7e55-4fc2-a334-d4c4b45cae8b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Returning 404 to user: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:01:06.359667 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-de243dd5-7e55-4fc2-a334-d4c4b45cae8b tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042440 May 10 14:01:06.360696 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 93/171] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:01:06 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:01:06.412584 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-da605830-2299-4d9f-b731-ff0ca7647492 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:06.416201 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-da605830-2299-4d9f-b731-ff0ca7647492 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:06.424345 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-da605830-2299-4d9f-b731-ff0ca7647492 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:06.424793 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-da605830-2299-4d9f-b731-ff0ca7647492 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:06.425577 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-da605830-2299-4d9f-b731-ff0ca7647492 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:06.426008 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-da605830-2299-4d9f-b731-ff0ca7647492 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:06.572550 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-da605830-2299-4d9f-b731-ff0ca7647492 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:06.580507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-da605830-2299-4d9f-b731-ff0ca7647492 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.171660 May 10 14:01:06.581284 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 79/172] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:06 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:07.598401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d3c4387b-f40f-4e9f-9c49-43393aaba99b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:07.598940 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d3c4387b-f40f-4e9f-9c49-43393aaba99b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:07.606049 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d3c4387b-f40f-4e9f-9c49-43393aaba99b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:07.606502 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d3c4387b-f40f-4e9f-9c49-43393aaba99b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:07.607272 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d3c4387b-f40f-4e9f-9c49-43393aaba99b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:07.607709 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d3c4387b-f40f-4e9f-9c49-43393aaba99b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:07.731954 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d3c4387b-f40f-4e9f-9c49-43393aaba99b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:07.739379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d3c4387b-f40f-4e9f-9c49-43393aaba99b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.144998 May 10 14:01:07.739953 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 94/173] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:07 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:08.755733 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-654ec671-bd69-44d5-bd59-9d08d2bb8471 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:08.756392 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-654ec671-bd69-44d5-bd59-9d08d2bb8471 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:08.762854 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-654ec671-bd69-44d5-bd59-9d08d2bb8471 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:08.763304 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-654ec671-bd69-44d5-bd59-9d08d2bb8471 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:08.764082 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-654ec671-bd69-44d5-bd59-9d08d2bb8471 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:08.764538 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-654ec671-bd69-44d5-bd59-9d08d2bb8471 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:08.890936 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-654ec671-bd69-44d5-bd59-9d08d2bb8471 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:08.898528 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-654ec671-bd69-44d5-bd59-9d08d2bb8471 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.146745 May 10 14:01:08.899091 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 80/174] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:08 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:09.914891 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1754188e-cf52-4ad6-ab28-fbe6109c2518 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:09.915480 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1754188e-cf52-4ad6-ab28-fbe6109c2518 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:09.922393 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1754188e-cf52-4ad6-ab28-fbe6109c2518 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:09.922860 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1754188e-cf52-4ad6-ab28-fbe6109c2518 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:09.923641 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1754188e-cf52-4ad6-ab28-fbe6109c2518 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:09.924085 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1754188e-cf52-4ad6-ab28-fbe6109c2518 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:10.058166 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1754188e-cf52-4ad6-ab28-fbe6109c2518 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:10.066829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1754188e-cf52-4ad6-ab28-fbe6109c2518 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.155831 May 10 14:01:10.067414 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 95/175] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:09 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:10.715078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-abcc20f1-d143-48ae-af81-db6e068fc22e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:10.715583 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-abcc20f1-d143-48ae-af81-db6e068fc22e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:10.721575 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-abcc20f1-d143-48ae-af81-db6e068fc22e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:10.722030 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-abcc20f1-d143-48ae-af81-db6e068fc22e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:10.722799 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-abcc20f1-d143-48ae-af81-db6e068fc22e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:10.723234 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-abcc20f1-d143-48ae-af81-db6e068fc22e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:10.736983 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-abcc20f1-d143-48ae-af81-db6e068fc22e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] HTTP exception thrown: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-abcc20f1-d143-48ae-af81-db6e068fc22e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Request method failure captured: May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: DELETE /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 HTTP/1.1 May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_b23gRdShku8eR4JWSACwESDyr9ldCAsH18qLEq5IOBuK-0ejwFrxuosatCC79WW4Kt9Y1t2MXaz5NOS3YQElmSHJgSie6OlKjCGlZf_WnX7sA_QTUEppYevSecs8MrNBvHol-PtG5gksMLGWcn8ldqb1gQvtoPSm5zyoDhTgNLes May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 854eb7b7a9a44ca283e9c95ce935624d May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-DeleteServersTestJSON-1958402780 May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:01:10.738506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:01:10.739933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:01:10.739933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-DeleteServersTestJSON-1958402780 May 10 14:01:10.739933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 854eb7b7a9a44ca283e9c95ce935624d May 10 14:01:10.739933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-DeleteServersTestJSON-1958402780 May 10 14:01:10.739933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-DeleteServersTestJSON-1958402780-project May 10 14:01:10.739933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:01:10.739933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:01:10.739933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: e2218b6609f344dc94f91247e8504e85 May 10 14:01:10.739933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-DeleteServersTestJSON-1958402780-project May 10 14:01:10.739933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:01:10.739933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:10.739933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '983a758b-f633-43b1-9215-c91fadb59ff6'} May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:01:10.740782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:10.742166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:01:10.743438 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-abcc20f1-d143-48ae-af81-db6e068fc22e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Returning 404 to user: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:01:10.743438 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-abcc20f1-d143-48ae-af81-db6e068fc22e tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "DELETE /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 404 len: 111 microversion: 2.1 time: 0.028777 May 10 14:01:10.743438 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 81/176] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:01:10 2022] DELETE /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:01:10.752802 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e5b0abfe-737d-40a0-87c1-bfe3bb258503 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:10.753415 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e5b0abfe-737d-40a0-87c1-bfe3bb258503 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] [instance: 983a758b-f633-43b1-9215-c91fadb59ff6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:10.759823 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5b0abfe-737d-40a0-87c1-bfe3bb258503 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:10.760407 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5b0abfe-737d-40a0-87c1-bfe3bb258503 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:10.761267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5b0abfe-737d-40a0-87c1-bfe3bb258503 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:10.761775 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5b0abfe-737d-40a0-87c1-bfe3bb258503 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:10.775686 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-e5b0abfe-737d-40a0-87c1-bfe3bb258503 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] HTTP exception thrown: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e5b0abfe-737d-40a0-87c1-bfe3bb258503 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Request method failure captured: May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 HTTP/1.1 May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_b23gRdShku8eR4JWSACwESDyr9ldCAsH18qLEq5IOBuK-0ejwFrxuosatCC79WW4Kt9Y1t2MXaz5NOS3YQElmSHJgSie6OlKjCGlZf_WnX7sA_QTUEppYevSecs8MrNBvHol-PtG5gksMLGWcn8ldqb1gQvtoPSm5zyoDhTgNLes May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 854eb7b7a9a44ca283e9c95ce935624d May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-DeleteServersTestJSON-1958402780 May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:01:10.777817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:01:10.779233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/854eb7b7a9a44ca283e9c95ce935624d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:01:10.779233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-DeleteServersTestJSON-1958402780 May 10 14:01:10.779233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 854eb7b7a9a44ca283e9c95ce935624d May 10 14:01:10.779233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-DeleteServersTestJSON-1958402780 May 10 14:01:10.779233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-DeleteServersTestJSON-1958402780-project May 10 14:01:10.779233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:01:10.779233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:01:10.779233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: e2218b6609f344dc94f91247e8504e85 May 10 14:01:10.779233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-DeleteServersTestJSON-1958402780-project May 10 14:01:10.779233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:01:10.779233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:10.779233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '983a758b-f633-43b1-9215-c91fadb59ff6'} May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:01:10.779987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. May 10 14:01:10.781207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:01:10.782191 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e5b0abfe-737d-40a0-87c1-bfe3bb258503 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] Returning 404 to user: Instance 983a758b-f633-43b1-9215-c91fadb59ff6 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:01:10.782191 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e5b0abfe-737d-40a0-87c1-bfe3bb258503 tempest-DeleteServersTestJSON-1958402780 tempest-DeleteServersTestJSON-1958402780-project] 10.222.0.49 "GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6" status: 404 len: 111 microversion: 2.1 time: 0.030889 May 10 14:01:10.782191 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 96/177] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:10 2022] GET /compute/v2.1/servers/983a758b-f633-43b1-9215-c91fadb59ff6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:01:11.084063 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5351cd1b-a758-40a8-82d1-c0882fc98b91 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:11.084705 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-5351cd1b-a758-40a8-82d1-c0882fc98b91 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:11.091184 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5351cd1b-a758-40a8-82d1-c0882fc98b91 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:11.091633 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5351cd1b-a758-40a8-82d1-c0882fc98b91 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:11.092425 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5351cd1b-a758-40a8-82d1-c0882fc98b91 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:11.092869 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5351cd1b-a758-40a8-82d1-c0882fc98b91 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:11.219205 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-5351cd1b-a758-40a8-82d1-c0882fc98b91 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:11.226745 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-5351cd1b-a758-40a8-82d1-c0882fc98b91 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.146471 May 10 14:01:11.227315 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 82/178] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:11 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:12.244083 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f4691b4d-f9c4-44aa-a8b4-9eed5f2a5d5f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:12.244811 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f4691b4d-f9c4-44aa-a8b4-9eed5f2a5d5f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:12.251652 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f4691b4d-f9c4-44aa-a8b4-9eed5f2a5d5f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:12.252099 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f4691b4d-f9c4-44aa-a8b4-9eed5f2a5d5f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:12.252910 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f4691b4d-f9c4-44aa-a8b4-9eed5f2a5d5f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:12.253340 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f4691b4d-f9c4-44aa-a8b4-9eed5f2a5d5f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:12.390067 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f4691b4d-f9c4-44aa-a8b4-9eed5f2a5d5f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:12.397895 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f4691b4d-f9c4-44aa-a8b4-9eed5f2a5d5f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.157487 May 10 14:01:12.398468 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 97/179] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:12 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:13.415026 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-551e9262-fc7b-469a-9146-1ec57912f44c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:13.415757 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-551e9262-fc7b-469a-9146-1ec57912f44c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:13.422567 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-551e9262-fc7b-469a-9146-1ec57912f44c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:13.423097 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-551e9262-fc7b-469a-9146-1ec57912f44c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:13.423927 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-551e9262-fc7b-469a-9146-1ec57912f44c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:13.424469 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-551e9262-fc7b-469a-9146-1ec57912f44c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:13.611561 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-551e9262-fc7b-469a-9146-1ec57912f44c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:13.620193 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-551e9262-fc7b-469a-9146-1ec57912f44c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.209190 May 10 14:01:13.621202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 83/180] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:13 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:14.639255 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d5848668-6d14-4431-b787-8881aaebb085 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:14.640753 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d5848668-6d14-4431-b787-8881aaebb085 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:14.650217 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d5848668-6d14-4431-b787-8881aaebb085 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:14.651752 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d5848668-6d14-4431-b787-8881aaebb085 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:14.652740 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d5848668-6d14-4431-b787-8881aaebb085 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:14.653257 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d5848668-6d14-4431-b787-8881aaebb085 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:14.800446 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d5848668-6d14-4431-b787-8881aaebb085 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:14.809075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d5848668-6d14-4431-b787-8881aaebb085 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.174343 May 10 14:01:14.811205 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 98/181] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:14 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:15.826540 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3417b78b-e512-4dce-af03-b091f45551f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:15.827366 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-3417b78b-e512-4dce-af03-b091f45551f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:15.833733 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3417b78b-e512-4dce-af03-b091f45551f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:15.834377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3417b78b-e512-4dce-af03-b091f45551f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:15.835452 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3417b78b-e512-4dce-af03-b091f45551f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:15.835988 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3417b78b-e512-4dce-af03-b091f45551f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:15.963165 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3417b78b-e512-4dce-af03-b091f45551f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:15.972151 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3417b78b-e512-4dce-af03-b091f45551f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.149854 May 10 14:01:15.972764 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 84/182] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:15 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:16.991739 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e4a14fb1-f1cb-4767-8f18-f1e9a5348dcc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:16.992779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e4a14fb1-f1cb-4767-8f18-f1e9a5348dcc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:17.000477 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4a14fb1-f1cb-4767-8f18-f1e9a5348dcc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:17.000931 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4a14fb1-f1cb-4767-8f18-f1e9a5348dcc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:17.001703 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4a14fb1-f1cb-4767-8f18-f1e9a5348dcc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:17.002142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4a14fb1-f1cb-4767-8f18-f1e9a5348dcc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:17.128285 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e4a14fb1-f1cb-4767-8f18-f1e9a5348dcc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:17.138107 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e4a14fb1-f1cb-4767-8f18-f1e9a5348dcc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.151205 May 10 14:01:17.138783 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 99/183] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:16 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:18.156369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-73da6b93-7273-4593-8a70-f71c28a331fd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:18.157021 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-73da6b93-7273-4593-8a70-f71c28a331fd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:18.167461 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-73da6b93-7273-4593-8a70-f71c28a331fd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:18.168527 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-73da6b93-7273-4593-8a70-f71c28a331fd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:18.170629 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-73da6b93-7273-4593-8a70-f71c28a331fd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:18.171621 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-73da6b93-7273-4593-8a70-f71c28a331fd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:18.304351 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-73da6b93-7273-4593-8a70-f71c28a331fd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:18.313045 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-73da6b93-7273-4593-8a70-f71c28a331fd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.162334 May 10 14:01:18.313614 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 85/184] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:18 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:19.330002 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e7e54cf0-1be9-4e85-bd60-fc6fe1603b87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:19.330833 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e7e54cf0-1be9-4e85-bd60-fc6fe1603b87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:19.336942 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e7e54cf0-1be9-4e85-bd60-fc6fe1603b87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:19.337391 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e7e54cf0-1be9-4e85-bd60-fc6fe1603b87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:19.338147 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e7e54cf0-1be9-4e85-bd60-fc6fe1603b87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:19.339157 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e7e54cf0-1be9-4e85-bd60-fc6fe1603b87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:19.462979 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e7e54cf0-1be9-4e85-bd60-fc6fe1603b87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:19.470299 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e7e54cf0-1be9-4e85-bd60-fc6fe1603b87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.144107 May 10 14:01:19.470867 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 100/185] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:19 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:20.486542 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-12b291f7-79f7-4cec-8670-98acf67615c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:20.487152 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-12b291f7-79f7-4cec-8670-98acf67615c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:20.493062 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-12b291f7-79f7-4cec-8670-98acf67615c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:20.493514 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-12b291f7-79f7-4cec-8670-98acf67615c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:20.494274 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-12b291f7-79f7-4cec-8670-98acf67615c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:20.495294 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-12b291f7-79f7-4cec-8670-98acf67615c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:20.625710 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-12b291f7-79f7-4cec-8670-98acf67615c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:20.633493 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-12b291f7-79f7-4cec-8670-98acf67615c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.150793 May 10 14:01:20.634058 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 86/186] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:20 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:21.650589 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1f87800b-5efd-4249-9913-f99946e42db4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:21.651195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1f87800b-5efd-4249-9913-f99946e42db4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:21.657615 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1f87800b-5efd-4249-9913-f99946e42db4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:21.658055 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1f87800b-5efd-4249-9913-f99946e42db4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:21.658813 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1f87800b-5efd-4249-9913-f99946e42db4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:21.659240 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1f87800b-5efd-4249-9913-f99946e42db4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:21.784566 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1f87800b-5efd-4249-9913-f99946e42db4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:21.791907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1f87800b-5efd-4249-9913-f99946e42db4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.145230 May 10 14:01:21.792504 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 101/187] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:21 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:22.808232 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-51a8bcd8-5d85-4f43-b544-5aee9afc5362 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:22.808846 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-51a8bcd8-5d85-4f43-b544-5aee9afc5362 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:22.814582 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-51a8bcd8-5d85-4f43-b544-5aee9afc5362 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:22.815041 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-51a8bcd8-5d85-4f43-b544-5aee9afc5362 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:22.815806 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-51a8bcd8-5d85-4f43-b544-5aee9afc5362 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:22.816470 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-51a8bcd8-5d85-4f43-b544-5aee9afc5362 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:22.953349 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-51a8bcd8-5d85-4f43-b544-5aee9afc5362 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:22.961437 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-51a8bcd8-5d85-4f43-b544-5aee9afc5362 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.157530 May 10 14:01:22.962019 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 87/188] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:22 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:23.979801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1d000084-12ea-4ebd-94e6-ebedc4c75349 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:23.981087 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1d000084-12ea-4ebd-94e6-ebedc4c75349 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:23.988289 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d000084-12ea-4ebd-94e6-ebedc4c75349 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:23.989017 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d000084-12ea-4ebd-94e6-ebedc4c75349 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:23.990064 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d000084-12ea-4ebd-94e6-ebedc4c75349 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:23.991267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d000084-12ea-4ebd-94e6-ebedc4c75349 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:24.173677 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1d000084-12ea-4ebd-94e6-ebedc4c75349 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:24.181234 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1d000084-12ea-4ebd-94e6-ebedc4c75349 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.206303 May 10 14:01:24.181814 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 102/189] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:23 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:25.198908 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e0a92784-a045-4e6f-ba90-b212f569695d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:25.199755 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e0a92784-a045-4e6f-ba90-b212f569695d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:25.207106 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e0a92784-a045-4e6f-ba90-b212f569695d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:25.207566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e0a92784-a045-4e6f-ba90-b212f569695d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:25.208947 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e0a92784-a045-4e6f-ba90-b212f569695d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:25.209395 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e0a92784-a045-4e6f-ba90-b212f569695d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:25.378058 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e0a92784-a045-4e6f-ba90-b212f569695d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:25.386522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e0a92784-a045-4e6f-ba90-b212f569695d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.191964 May 10 14:01:25.387282 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 88/190] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:25 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:26.404761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-237e04c2-8a19-4ea5-893d-3a7d3c04cb45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:26.405473 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-237e04c2-8a19-4ea5-893d-3a7d3c04cb45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:26.411933 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-237e04c2-8a19-4ea5-893d-3a7d3c04cb45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:26.412525 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-237e04c2-8a19-4ea5-893d-3a7d3c04cb45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:26.413379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-237e04c2-8a19-4ea5-893d-3a7d3c04cb45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:26.413924 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-237e04c2-8a19-4ea5-893d-3a7d3c04cb45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:26.547874 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-237e04c2-8a19-4ea5-893d-3a7d3c04cb45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:26.555563 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-237e04c2-8a19-4ea5-893d-3a7d3c04cb45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.155809 May 10 14:01:26.556141 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 103/191] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:26 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:27.573230 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d874706e-4019-4940-9e2c-0004498e7976 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:27.574674 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d874706e-4019-4940-9e2c-0004498e7976 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:27.583862 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d874706e-4019-4940-9e2c-0004498e7976 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:27.584594 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d874706e-4019-4940-9e2c-0004498e7976 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:27.588006 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d874706e-4019-4940-9e2c-0004498e7976 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:27.588555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d874706e-4019-4940-9e2c-0004498e7976 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:27.789261 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d874706e-4019-4940-9e2c-0004498e7976 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:27.797309 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d874706e-4019-4940-9e2c-0004498e7976 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.228487 May 10 14:01:27.807817 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 89/192] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:27 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:28.815425 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9c7ea8de-7015-48ea-b142-aa04e9ba3468 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:28.816694 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9c7ea8de-7015-48ea-b142-aa04e9ba3468 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:28.824894 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9c7ea8de-7015-48ea-b142-aa04e9ba3468 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:28.825529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9c7ea8de-7015-48ea-b142-aa04e9ba3468 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:28.827247 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9c7ea8de-7015-48ea-b142-aa04e9ba3468 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:28.827992 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9c7ea8de-7015-48ea-b142-aa04e9ba3468 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:29.091464 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9c7ea8de-7015-48ea-b142-aa04e9ba3468 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:29.100916 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9c7ea8de-7015-48ea-b142-aa04e9ba3468 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.289782 May 10 14:01:29.112742 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 104/193] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:28 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:30.119651 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-57a8aea2-fba5-44c3-bd2f-5f1f6ae7012c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:30.120840 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-57a8aea2-fba5-44c3-bd2f-5f1f6ae7012c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:30.135947 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-57a8aea2-fba5-44c3-bd2f-5f1f6ae7012c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:30.136749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-57a8aea2-fba5-44c3-bd2f-5f1f6ae7012c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:30.138142 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-57a8aea2-fba5-44c3-bd2f-5f1f6ae7012c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:30.138788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-57a8aea2-fba5-44c3-bd2f-5f1f6ae7012c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:30.346075 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-57a8aea2-fba5-44c3-bd2f-5f1f6ae7012c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:30.356625 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-57a8aea2-fba5-44c3-bd2f-5f1f6ae7012c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.241463 May 10 14:01:30.366219 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 90/194] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:30 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:31.375498 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8fe16ff2-0636-4285-962b-2d23c2f03b2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:31.376250 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8fe16ff2-0636-4285-962b-2d23c2f03b2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:31.386372 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8fe16ff2-0636-4285-962b-2d23c2f03b2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:31.387081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8fe16ff2-0636-4285-962b-2d23c2f03b2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:31.389284 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8fe16ff2-0636-4285-962b-2d23c2f03b2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:31.390057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8fe16ff2-0636-4285-962b-2d23c2f03b2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:31.618112 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8fe16ff2-0636-4285-962b-2d23c2f03b2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:31.625974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8fe16ff2-0636-4285-962b-2d23c2f03b2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.256040 May 10 14:01:31.626562 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 105/195] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:31 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:32.644376 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7da3960d-d506-4aaa-ab25-b16424e1472a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:32.644986 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7da3960d-d506-4aaa-ab25-b16424e1472a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:32.654873 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7da3960d-d506-4aaa-ab25-b16424e1472a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:32.656709 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7da3960d-d506-4aaa-ab25-b16424e1472a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:32.662303 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7da3960d-d506-4aaa-ab25-b16424e1472a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:32.662938 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7da3960d-d506-4aaa-ab25-b16424e1472a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:33.019296 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7da3960d-d506-4aaa-ab25-b16424e1472a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:33.029184 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7da3960d-d506-4aaa-ab25-b16424e1472a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.389893 May 10 14:01:33.029876 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 91/196] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:32 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:34.048935 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-733e526d-673d-424f-abbb-00d06c071cfd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:34.075642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-733e526d-673d-424f-abbb-00d06c071cfd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:34.095532 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-733e526d-673d-424f-abbb-00d06c071cfd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:34.097213 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-733e526d-673d-424f-abbb-00d06c071cfd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:34.099855 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-733e526d-673d-424f-abbb-00d06c071cfd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:34.102396 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-733e526d-673d-424f-abbb-00d06c071cfd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:34.863934 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-733e526d-673d-424f-abbb-00d06c071cfd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:34.881948 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-733e526d-673d-424f-abbb-00d06c071cfd tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.835461 May 10 14:01:34.882686 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 106/197] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:34 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:35.899654 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-800cb178-2b6e-4f30-8eec-950479403b9e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:35.900330 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-800cb178-2b6e-4f30-8eec-950479403b9e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:35.907553 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-800cb178-2b6e-4f30-8eec-950479403b9e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:35.908034 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-800cb178-2b6e-4f30-8eec-950479403b9e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:35.908789 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-800cb178-2b6e-4f30-8eec-950479403b9e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:35.909220 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-800cb178-2b6e-4f30-8eec-950479403b9e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:36.137673 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-800cb178-2b6e-4f30-8eec-950479403b9e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:36.148856 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-800cb178-2b6e-4f30-8eec-950479403b9e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1521 microversion: 2.1 time: 0.251935 May 10 14:01:36.149530 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 92/198] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:35 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:37.167353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-14bc6d06-d26f-4412-afae-b52861081d32 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:37.167974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-14bc6d06-d26f-4412-afae-b52861081d32 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:37.182715 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-14bc6d06-d26f-4412-afae-b52861081d32 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:37.183629 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-14bc6d06-d26f-4412-afae-b52861081d32 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:37.186432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-14bc6d06-d26f-4412-afae-b52861081d32 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:37.188317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-14bc6d06-d26f-4412-afae-b52861081d32 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:37.430947 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-14bc6d06-d26f-4412-afae-b52861081d32 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:37.444262 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-14bc6d06-d26f-4412-afae-b52861081d32 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1501 microversion: 2.1 time: 0.281608 May 10 14:01:37.447815 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 107/199] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:37 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1501 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:37.467448 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8ddbd520-39af-4562-b3f3-066b615619f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:37.468276 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8ddbd520-39af-4562-b3f3-066b615619f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:37.481053 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8ddbd520-39af-4562-b3f3-066b615619f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:37.485090 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8ddbd520-39af-4562-b3f3-066b615619f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:37.486155 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8ddbd520-39af-4562-b3f3-066b615619f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:37.486933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8ddbd520-39af-4562-b3f3-066b615619f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:38.198172 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8ddbd520-39af-4562-b3f3-066b615619f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:38.228975 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8ddbd520-39af-4562-b3f3-066b615619f9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1516 microversion: 2.1 time: 0.758733 May 10 14:01:38.230127 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 93/200] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:37 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1516 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:40.131803 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3782ead8-046a-49ee-be23-daa78761783f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:40.132788 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3782ead8-046a-49ee-be23-daa78761783f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:40.154393 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3782ead8-046a-49ee-be23-daa78761783f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:40.155105 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3782ead8-046a-49ee-be23-daa78761783f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:40.156108 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3782ead8-046a-49ee-be23-daa78761783f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:40.157956 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3782ead8-046a-49ee-be23-daa78761783f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:40.208226 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-3782ead8-046a-49ee-be23-daa78761783f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lazy-loading 'flavor' on Instance uuid 54be9a2c-c327-4249-ba65-0fc49162bac7 {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:01:40.367116 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3782ead8-046a-49ee-be23-daa78761783f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "POST /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7/action" status: 200 len: 32 microversion: 2.1 time: 0.239248 May 10 14:01:40.368259 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 108/201] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:01:40 2022] POST /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:01:40.387843 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-457b4f95-e416-40dd-9a63-e20e4622001a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:40.388952 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-457b4f95-e416-40dd-9a63-e20e4622001a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:40.396025 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-457b4f95-e416-40dd-9a63-e20e4622001a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:40.396507 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-457b4f95-e416-40dd-9a63-e20e4622001a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:40.397555 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-457b4f95-e416-40dd-9a63-e20e4622001a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:40.397991 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-457b4f95-e416-40dd-9a63-e20e4622001a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:40.514026 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ee167f8e-5daa-4d4c-a2c6-910eedc70ddb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Action: 'create', calling method: .version_select at 0x7f5f7c47b820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-379745293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4yP0UzTuVAq3TXjn83hhtBeAsd0eXc8Rn6R3er84iJOJxHUocaAjyxJrslDICK5sq7HmpJI13QPlPpYTlxWAF/inOkLby7940TDVCpTuyZLV8cYYnS6nP1VNbN8gfHVA=="}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:40.531372 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-ee167f8e-5daa-4d4c-a2c6-910eedc70ddb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Getting quotas for project 104740054c3a47ca8cc3cb262d975fd5. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:01:40.535888 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-ee167f8e-5daa-4d4c-a2c6-910eedc70ddb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Getting quotas for user 9d87a4de3fbf4cbb9e21523634007629 and project 104740054c3a47ca8cc3cb262d975fd5. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:01:40.570385 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-457b4f95-e416-40dd-9a63-e20e4622001a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:40.578169 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-457b4f95-e416-40dd-9a63-e20e4622001a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.200853 May 10 14:01:40.579165 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 109/202] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:40 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:40.579663 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ee167f8e-5daa-4d4c-a2c6-910eedc70ddb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.355412 May 10 14:01:40.580283 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 94/203] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 14:01:40 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:01:41.608553 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1a353306-b945-45db-b8c1-94cfcdb9e690 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:41.609248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1a353306-b945-45db-b8c1-94cfcdb9e690 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:41.618312 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1a353306-b945-45db-b8c1-94cfcdb9e690 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:41.619413 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1a353306-b945-45db-b8c1-94cfcdb9e690 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:41.620780 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1a353306-b945-45db-b8c1-94cfcdb9e690 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:41.621379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1a353306-b945-45db-b8c1-94cfcdb9e690 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:41.908796 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1a353306-b945-45db-b8c1-94cfcdb9e690 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:41.921134 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1a353306-b945-45db-b8c1-94cfcdb9e690 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.320416 May 10 14:01:41.933221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 110/204] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:41 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:42.943402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9b24dd65-556e-48df-8ab1-503475e0cb8c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:42.946831 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9b24dd65-556e-48df-8ab1-503475e0cb8c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:42.960437 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9b24dd65-556e-48df-8ab1-503475e0cb8c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:42.964758 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9b24dd65-556e-48df-8ab1-503475e0cb8c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:42.966768 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9b24dd65-556e-48df-8ab1-503475e0cb8c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:42.968913 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9b24dd65-556e-48df-8ab1-503475e0cb8c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:43.284765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9b24dd65-556e-48df-8ab1-503475e0cb8c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:43.306802 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9b24dd65-556e-48df-8ab1-503475e0cb8c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.368479 May 10 14:01:43.307908 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 95/205] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:42 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:44.324140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1fb2ae20-463f-4677-b239-69c6d237c431 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:44.324768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1fb2ae20-463f-4677-b239-69c6d237c431 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:44.335730 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1fb2ae20-463f-4677-b239-69c6d237c431 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:44.336208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1fb2ae20-463f-4677-b239-69c6d237c431 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:44.339851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1fb2ae20-463f-4677-b239-69c6d237c431 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:44.340355 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1fb2ae20-463f-4677-b239-69c6d237c431 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:44.606199 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1fb2ae20-463f-4677-b239-69c6d237c431 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:44.617580 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1fb2ae20-463f-4677-b239-69c6d237c431 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.297656 May 10 14:01:44.638981 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 111/206] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:44 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:45.649988 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4142737b-b060-4ddb-a771-972dbdd42b2a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:45.650628 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4142737b-b060-4ddb-a771-972dbdd42b2a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:45.668252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4142737b-b060-4ddb-a771-972dbdd42b2a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:45.674535 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4142737b-b060-4ddb-a771-972dbdd42b2a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:45.681269 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4142737b-b060-4ddb-a771-972dbdd42b2a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:45.681882 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4142737b-b060-4ddb-a771-972dbdd42b2a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:46.021883 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4142737b-b060-4ddb-a771-972dbdd42b2a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:46.044871 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4142737b-b060-4ddb-a771-972dbdd42b2a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.402186 May 10 14:01:46.045777 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 96/207] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:45 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:47.069992 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-91ebd9de-f188-4494-bb06-3efcec02088c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:47.074860 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-91ebd9de-f188-4494-bb06-3efcec02088c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:47.091809 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-91ebd9de-f188-4494-bb06-3efcec02088c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:47.092123 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-91ebd9de-f188-4494-bb06-3efcec02088c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:47.092959 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-91ebd9de-f188-4494-bb06-3efcec02088c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:47.094043 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-91ebd9de-f188-4494-bb06-3efcec02088c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:47.501009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-91ebd9de-f188-4494-bb06-3efcec02088c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:47.511688 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-91ebd9de-f188-4494-bb06-3efcec02088c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.448671 May 10 14:01:47.521340 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 112/208] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:47 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:48.531864 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-367ecd0e-8e9d-430c-978b-b15b8d038dd8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:48.532630 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-367ecd0e-8e9d-430c-978b-b15b8d038dd8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:48.539271 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-367ecd0e-8e9d-430c-978b-b15b8d038dd8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:48.540001 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-367ecd0e-8e9d-430c-978b-b15b8d038dd8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:48.541351 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-367ecd0e-8e9d-430c-978b-b15b8d038dd8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:48.541879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-367ecd0e-8e9d-430c-978b-b15b8d038dd8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:48.905045 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-367ecd0e-8e9d-430c-978b-b15b8d038dd8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:48.917448 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-367ecd0e-8e9d-430c-978b-b15b8d038dd8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.388186 May 10 14:01:48.918324 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 97/209] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:48 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:49.934745 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-dc0fdc3b-1b76-4b15-962a-708f0e37cfe5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:49.935343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-dc0fdc3b-1b76-4b15-962a-708f0e37cfe5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:49.941926 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-dc0fdc3b-1b76-4b15-962a-708f0e37cfe5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:49.942660 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-dc0fdc3b-1b76-4b15-962a-708f0e37cfe5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:49.943704 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-dc0fdc3b-1b76-4b15-962a-708f0e37cfe5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:49.944322 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-dc0fdc3b-1b76-4b15-962a-708f0e37cfe5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:50.316357 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-dc0fdc3b-1b76-4b15-962a-708f0e37cfe5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:50.327239 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-dc0fdc3b-1b76-4b15-962a-708f0e37cfe5 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.396244 May 10 14:01:50.328660 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 113/210] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:49 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:51.347420 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-dcd20f9c-f2ea-4e33-a718-4f94b0077355 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:51.348223 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-dcd20f9c-f2ea-4e33-a718-4f94b0077355 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:51.358046 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dcd20f9c-f2ea-4e33-a718-4f94b0077355 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:51.360638 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dcd20f9c-f2ea-4e33-a718-4f94b0077355 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:51.363067 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dcd20f9c-f2ea-4e33-a718-4f94b0077355 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:51.365002 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dcd20f9c-f2ea-4e33-a718-4f94b0077355 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:51.621192 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-dcd20f9c-f2ea-4e33-a718-4f94b0077355 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:51.642223 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-dcd20f9c-f2ea-4e33-a718-4f94b0077355 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.299519 May 10 14:01:51.651627 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 98/211] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:51 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:52.610787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-89a6fb14-2b92-4ebd-b2e1-41a57fd45211 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:52.611952 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-89a6fb14-2b92-4ebd-b2e1-41a57fd45211 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:52.623561 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89a6fb14-2b92-4ebd-b2e1-41a57fd45211 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:52.627118 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89a6fb14-2b92-4ebd-b2e1-41a57fd45211 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:52.630966 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89a6fb14-2b92-4ebd-b2e1-41a57fd45211 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:52.631666 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89a6fb14-2b92-4ebd-b2e1-41a57fd45211 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:52.664196 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-60a1b483-a916-4719-bc39-48d20c42361d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:52.666001 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-60a1b483-a916-4719-bc39-48d20c42361d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:52.674211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-60a1b483-a916-4719-bc39-48d20c42361d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:52.675244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-60a1b483-a916-4719-bc39-48d20c42361d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:52.676723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-60a1b483-a916-4719-bc39-48d20c42361d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:52.678124 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-60a1b483-a916-4719-bc39-48d20c42361d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:52.699190 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-89a6fb14-2b92-4ebd-b2e1-41a57fd45211 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/ips" status: 200 len: 151 microversion: 2.20 time: 0.093216 May 10 14:01:52.705612 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 114/212] 10.222.0.49 () {60 vars in 1288 bytes} [Tue May 10 14:01:52 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/ips => generated 151 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:01:52.751038 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-806135703", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:52.889746 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] validate_networks() for None {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:01:53.263644 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-60a1b483-a916-4719-bc39-48d20c42361d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:53.277637 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-60a1b483-a916-4719-bc39-48d20c42361d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.621079 May 10 14:01:53.294316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 99/213] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:52 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:53.360893 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-51aae69a-6f47-4798-9da8-0c1bb1074ec7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:53.361662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-51aae69a-6f47-4798-9da8-0c1bb1074ec7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:53.373604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-51aae69a-6f47-4798-9da8-0c1bb1074ec7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:53.376160 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-51aae69a-6f47-4798-9da8-0c1bb1074ec7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:53.378996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-51aae69a-6f47-4798-9da8-0c1bb1074ec7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:53.383050 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-51aae69a-6f47-4798-9da8-0c1bb1074ec7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:53.448466 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-51aae69a-6f47-4798-9da8-0c1bb1074ec7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/ips" status: 200 len: 144 microversion: 2.1 time: 0.092420 May 10 14:01:53.460242 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 100/214] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 14:01:53 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/ips => generated 144 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:54.016824 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:01:54.018899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:01:54.019702 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:01:54.020411 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:01:54.023693 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:01:54.041663 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:54.042525 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:54.050204 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:54.050204 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:54.079747 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Getting quotas for project cdc4505b52714863b9bf8143c27f0a02. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:01:54.086208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Getting quotas for user c4d7e361f048469aa63bcb2fac42ed83 and project cdc4505b52714863b9bf8143c27f0a02. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:01:54.106480 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:01:54.113742 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:01:54.155743 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-dfa3f81d-2019-4145-bf5c-b0ef7c7afd4e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:54.157227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-dfa3f81d-2019-4145-bf5c-b0ef7c7afd4e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:54.176054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dfa3f81d-2019-4145-bf5c-b0ef7c7afd4e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:54.178091 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dfa3f81d-2019-4145-bf5c-b0ef7c7afd4e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:54.179659 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dfa3f81d-2019-4145-bf5c-b0ef7c7afd4e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:54.181171 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dfa3f81d-2019-4145-bf5c-b0ef7c7afd4e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:54.238026 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9ae7dd03-dfed-4178-9dc6-e8e82252d36b tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.493128 May 10 14:01:54.238709 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 115/215] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:01:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:01:54.255361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-dfa3f81d-2019-4145-bf5c-b0ef7c7afd4e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/ips" status: 200 len: 149 microversion: 2.1 time: 0.086195 May 10 14:01:54.259823 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 101/216] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 14:01:54 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/ips => generated 149 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:54.262675 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f648f24f-8929-427b-9672-4d74d72bd2a9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:54.262675 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f648f24f-8929-427b-9672-4d74d72bd2a9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:54.300954 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8660e893-de5d-495f-abc7-f02b09a187e3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:54.301691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8660e893-de5d-495f-abc7-f02b09a187e3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:54.318606 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8660e893-de5d-495f-abc7-f02b09a187e3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:54.319845 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8660e893-de5d-495f-abc7-f02b09a187e3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:54.321623 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8660e893-de5d-495f-abc7-f02b09a187e3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:54.322286 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8660e893-de5d-495f-abc7-f02b09a187e3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:54.469347 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f648f24f-8929-427b-9672-4d74d72bd2a9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:54.478265 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f648f24f-8929-427b-9672-4d74d72bd2a9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1214 microversion: 2.1 time: 0.229931 May 10 14:01:54.502133 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 116/217] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:54 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1214 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:54.832741 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8660e893-de5d-495f-abc7-f02b09a187e3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:54.885077 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8660e893-de5d-495f-abc7-f02b09a187e3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.593789 May 10 14:01:54.886301 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 102/218] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:54 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:55.526654 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-89b155d5-2849-49f8-84f0-3f1f012b5ee9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:55.527983 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-89b155d5-2849-49f8-84f0-3f1f012b5ee9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:55.548842 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89b155d5-2849-49f8-84f0-3f1f012b5ee9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:55.552460 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89b155d5-2849-49f8-84f0-3f1f012b5ee9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:55.553851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89b155d5-2849-49f8-84f0-3f1f012b5ee9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:55.554447 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89b155d5-2849-49f8-84f0-3f1f012b5ee9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:55.889260 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-44c51f59-01dc-4314-8578-a8d20004b71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:55.889800 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-44c51f59-01dc-4314-8578-a8d20004b71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:55.893135 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-89b155d5-2849-49f8-84f0-3f1f012b5ee9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:55.903123 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-89b155d5-2849-49f8-84f0-3f1f012b5ee9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1266 microversion: 2.1 time: 0.386199 May 10 14:01:55.903560 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-44c51f59-01dc-4314-8578-a8d20004b71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:55.904017 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-44c51f59-01dc-4314-8578-a8d20004b71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:55.904633 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 117/219] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:55 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1266 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:55.911942 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f3e4e5be-650c-46ce-ad37-4ae66c391944 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:55.912853 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f3e4e5be-650c-46ce-ad37-4ae66c391944 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:55.917073 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-44c51f59-01dc-4314-8578-a8d20004b71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:55.917535 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-44c51f59-01dc-4314-8578-a8d20004b71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:55.920002 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f3e4e5be-650c-46ce-ad37-4ae66c391944 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:55.920521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f3e4e5be-650c-46ce-ad37-4ae66c391944 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:55.921320 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f3e4e5be-650c-46ce-ad37-4ae66c391944 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:55.921740 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f3e4e5be-650c-46ce-ad37-4ae66c391944 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:55.996973 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-44c51f59-01dc-4314-8578-a8d20004b71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lazy-loading 'flavor' on Instance uuid 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:01:56.185841 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f3e4e5be-650c-46ce-ad37-4ae66c391944 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:56.195058 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f3e4e5be-650c-46ce-ad37-4ae66c391944 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.288956 May 10 14:01:56.205456 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 118/220] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:55 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:56.213544 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-44a15fe0-132e-46dc-bf28-63d5b7d5c6c2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54e667c7-e04c-4293-a83c-2477fe4e8749"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:56.214729 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-44a15fe0-132e-46dc-bf28-63d5b7d5c6c2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:56.220999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-44a15fe0-132e-46dc-bf28-63d5b7d5c6c2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:56.221449 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-44a15fe0-132e-46dc-bf28-63d5b7d5c6c2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:56.222274 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-44a15fe0-132e-46dc-bf28-63d5b7d5c6c2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:56.222901 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-44a15fe0-132e-46dc-bf28-63d5b7d5c6c2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:56.629074 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-44a15fe0-132e-46dc-bf28-63d5b7d5c6c2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421363 May 10 14:01:56.630769 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 119/221] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:01:56 2022] POST /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/os-volume_attachments => generated 194 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:56.936511 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a8a6f373-2925-44ff-b2b1-bb87713b158f tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:56.940109 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a8a6f373-2925-44ff-b2b1-bb87713b158f tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:56.965498 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a8a6f373-2925-44ff-b2b1-bb87713b158f tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:56.966324 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a8a6f373-2925-44ff-b2b1-bb87713b158f tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:56.968209 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a8a6f373-2925-44ff-b2b1-bb87713b158f tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:56.968810 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a8a6f373-2925-44ff-b2b1-bb87713b158f tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:57.127316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a8a6f373-2925-44ff-b2b1-bb87713b158f tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:57.141312 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a8a6f373-2925-44ff-b2b1-bb87713b158f tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1272 microversion: 2.1 time: 0.220594 May 10 14:01:57.142674 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 120/222] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:56 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:57.216752 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c2d69fb1-c656-42cb-869a-98a831b7aba2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:57.217661 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c2d69fb1-c656-42cb-869a-98a831b7aba2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:57.231987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c2d69fb1-c656-42cb-869a-98a831b7aba2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:57.232467 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c2d69fb1-c656-42cb-869a-98a831b7aba2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:57.233253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c2d69fb1-c656-42cb-869a-98a831b7aba2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:57.240742 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c2d69fb1-c656-42cb-869a-98a831b7aba2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:57.413938 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c2d69fb1-c656-42cb-869a-98a831b7aba2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:57.422024 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c2d69fb1-c656-42cb-869a-98a831b7aba2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.210818 May 10 14:01:57.425136 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 121/223] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:57 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:58.159166 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f3076f52-7256-4bca-b677-28ea13db115e tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:58.159952 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f3076f52-7256-4bca-b677-28ea13db115e tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:58.171479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f3076f52-7256-4bca-b677-28ea13db115e tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:58.176011 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f3076f52-7256-4bca-b677-28ea13db115e tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:58.178550 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f3076f52-7256-4bca-b677-28ea13db115e tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:58.179492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f3076f52-7256-4bca-b677-28ea13db115e tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:58.319002 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f3076f52-7256-4bca-b677-28ea13db115e tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:58.328596 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f3076f52-7256-4bca-b677-28ea13db115e tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1272 microversion: 2.1 time: 0.173670 May 10 14:01:58.340043 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 122/224] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:58 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:58.347629 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1c93848d-c731-4885-b72e-e38f257f7d92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "190c68b1-47f2-4e4e-9988-b6a953b7b7c5"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:58.350241 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1c93848d-c731-4885-b72e-e38f257f7d92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:58.358242 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1c93848d-c731-4885-b72e-e38f257f7d92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:58.359013 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1c93848d-c731-4885-b72e-e38f257f7d92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:58.360369 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1c93848d-c731-4885-b72e-e38f257f7d92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:58.360964 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1c93848d-c731-4885-b72e-e38f257f7d92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:58.796651 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-44c51f59-01dc-4314-8578-a8d20004b71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "POST /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/action" status: 202 len: 0 microversion: 2.20 time: 2.914428 May 10 14:01:58.797296 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 103/225] 10.222.0.49 () {62 vars in 1318 bytes} [Tue May 10 14:01:55 2022] POST /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/action => generated 0 bytes in 2916 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 14:01:58.851471 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-460bb000-0183-42ad-9656-fc464dea04ba tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:58.853848 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-460bb000-0183-42ad-9656-fc464dea04ba tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:58.876201 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-460bb000-0183-42ad-9656-fc464dea04ba tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:58.876654 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-460bb000-0183-42ad-9656-fc464dea04ba tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:58.877435 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-460bb000-0183-42ad-9656-fc464dea04ba tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:58.877874 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-460bb000-0183-42ad-9656-fc464dea04ba tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:58.987020 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1c93848d-c731-4885-b72e-e38f257f7d92 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "POST /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.644691 May 10 14:01:58.988089 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 123/226] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:01:58 2022] POST /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:58.994996 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2c48a1ca-1d8d-4e45-a80b-ffe29cea9e44 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:59.003532 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2c48a1ca-1d8d-4e45-a80b-ffe29cea9e44 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:59.028022 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2c48a1ca-1d8d-4e45-a80b-ffe29cea9e44 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:59.033043 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2c48a1ca-1d8d-4e45-a80b-ffe29cea9e44 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:59.035182 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2c48a1ca-1d8d-4e45-a80b-ffe29cea9e44 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:59.038405 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2c48a1ca-1d8d-4e45-a80b-ffe29cea9e44 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:59.317197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2c48a1ca-1d8d-4e45-a80b-ffe29cea9e44 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:59.325551 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2c48a1ca-1d8d-4e45-a80b-ffe29cea9e44 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:59.332413 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2c48a1ca-1d8d-4e45-a80b-ffe29cea9e44 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:59.335994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2c48a1ca-1d8d-4e45-a80b-ffe29cea9e44 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.346574 May 10 14:01:59.338105 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 124/227] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:01:58 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:01:59.359358 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a39f0c6b-c29a-485e-9b0b-7df5553ea492 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:59.360075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a39f0c6b-c29a-485e-9b0b-7df5553ea492 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:59.375998 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a39f0c6b-c29a-485e-9b0b-7df5553ea492 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:59.376612 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a39f0c6b-c29a-485e-9b0b-7df5553ea492 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:59.377745 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a39f0c6b-c29a-485e-9b0b-7df5553ea492 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:59.378312 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a39f0c6b-c29a-485e-9b0b-7df5553ea492 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:59.526936 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-460bb000-0183-42ad-9656-fc464dea04ba tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:59.541774 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-460bb000-0183-42ad-9656-fc464dea04ba tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.729489 May 10 14:01:59.542393 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 104/228] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:58 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:59.673960 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a39f0c6b-c29a-485e-9b0b-7df5553ea492 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:59.682455 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a39f0c6b-c29a-485e-9b0b-7df5553ea492 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1314 microversion: 2.1 time: 0.330250 May 10 14:01:59.693172 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 125/229] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:01:59 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:00.355432 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-577f8909-910b-4b89-8bdc-04cea0ae89d2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:00.356047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-577f8909-910b-4b89-8bdc-04cea0ae89d2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:00.367164 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-577f8909-910b-4b89-8bdc-04cea0ae89d2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:00.367795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-577f8909-910b-4b89-8bdc-04cea0ae89d2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:00.368615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-577f8909-910b-4b89-8bdc-04cea0ae89d2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:00.369052 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-577f8909-910b-4b89-8bdc-04cea0ae89d2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:00.559284 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-6529fdee-9a12-47d8-8b34-595456babbf8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:00.560015 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-6529fdee-9a12-47d8-8b34-595456babbf8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:00.575864 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6529fdee-9a12-47d8-8b34-595456babbf8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:00.576515 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6529fdee-9a12-47d8-8b34-595456babbf8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:00.577681 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6529fdee-9a12-47d8-8b34-595456babbf8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:00.578220 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6529fdee-9a12-47d8-8b34-595456babbf8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:00.872803 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-577f8909-910b-4b89-8bdc-04cea0ae89d2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:00.885904 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-577f8909-910b-4b89-8bdc-04cea0ae89d2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:00.893009 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-577f8909-910b-4b89-8bdc-04cea0ae89d2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:00.899605 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-577f8909-910b-4b89-8bdc-04cea0ae89d2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.547750 May 10 14:02:00.905457 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 105/230] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:00 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:00.919128 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-6529fdee-9a12-47d8-8b34-595456babbf8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:00.921553 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3d08e113-558a-46f6-9da5-66384b870b38 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:00.922695 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-3d08e113-558a-46f6-9da5-66384b870b38 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:00.930924 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-6529fdee-9a12-47d8-8b34-595456babbf8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.375335 May 10 14:02:00.932030 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 126/231] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:00 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:00.940519 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3d08e113-558a-46f6-9da5-66384b870b38 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:00.947496 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3d08e113-558a-46f6-9da5-66384b870b38 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:00.948512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3d08e113-558a-46f6-9da5-66384b870b38 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:00.951103 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3d08e113-558a-46f6-9da5-66384b870b38 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:01.028664 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-3db1c659-c157-4b53-a087-9d8d6fcaa14e req-be2bd1c3-84d9-47d1-ad27-683f80f2500a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f8c575-d141-465e-a1d6-0a588d798efc", "tag": "9b6ddffa-174d-4fdc-9944-6f473aa96b81"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:01.047352 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-3db1c659-c157-4b53-a087-9d8d6fcaa14e req-be2bd1c3-84d9-47d1-ad27-683f80f2500a service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:01.053430 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-3db1c659-c157-4b53-a087-9d8d6fcaa14e req-be2bd1c3-84d9-47d1-ad27-683f80f2500a service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:01.070021 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-3db1c659-c157-4b53-a087-9d8d6fcaa14e req-be2bd1c3-84d9-47d1-ad27-683f80f2500a service nova] Creating event network-changed:9b6ddffa-174d-4fdc-9944-6f473aa96b81 for instance 69f8c575-d141-465e-a1d6-0a588d798efc on hv-cinder-84067 May 10 14:02:01.075415 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-3db1c659-c157-4b53-a087-9d8d6fcaa14e req-be2bd1c3-84d9-47d1-ad27-683f80f2500a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057053 May 10 14:02:01.076639 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 127/232] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:01.481207 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3d08e113-558a-46f6-9da5-66384b870b38 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:01.493168 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3d08e113-558a-46f6-9da5-66384b870b38 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1314 microversion: 2.1 time: 0.584543 May 10 14:02:01.493839 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 106/233] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:00 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:01.925808 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-050b5b1b-7fd7-4c0f-9492-5414a1489efc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:01.926637 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-050b5b1b-7fd7-4c0f-9492-5414a1489efc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:01.936313 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-050b5b1b-7fd7-4c0f-9492-5414a1489efc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:01.941150 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-050b5b1b-7fd7-4c0f-9492-5414a1489efc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:01.943379 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-050b5b1b-7fd7-4c0f-9492-5414a1489efc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:01.943907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-050b5b1b-7fd7-4c0f-9492-5414a1489efc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:01.949253 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ecfa592b-17d2-468b-99b7-bc66976f2a33 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:01.950140 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ecfa592b-17d2-468b-99b7-bc66976f2a33 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:01.958681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ecfa592b-17d2-468b-99b7-bc66976f2a33 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:01.959137 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ecfa592b-17d2-468b-99b7-bc66976f2a33 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:01.959923 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ecfa592b-17d2-468b-99b7-bc66976f2a33 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:01.960453 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ecfa592b-17d2-468b-99b7-bc66976f2a33 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:02.149431 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-050b5b1b-7fd7-4c0f-9492-5414a1489efc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:02.158156 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-050b5b1b-7fd7-4c0f-9492-5414a1489efc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:02.160007 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-050b5b1b-7fd7-4c0f-9492-5414a1489efc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:02.161463 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-050b5b1b-7fd7-4c0f-9492-5414a1489efc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.244721 May 10 14:02:02.162541 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 128/234] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:01 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:02.197341 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ecfa592b-17d2-468b-99b7-bc66976f2a33 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:02.208963 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ecfa592b-17d2-468b-99b7-bc66976f2a33 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.263979 May 10 14:02:02.209664 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 107/235] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:01 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:02.514850 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9d9b12ea-3683-4acd-a085-793225c4a658 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:02.515604 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9d9b12ea-3683-4acd-a085-793225c4a658 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:02.524920 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9d9b12ea-3683-4acd-a085-793225c4a658 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:02.526061 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9d9b12ea-3683-4acd-a085-793225c4a658 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:02.527168 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9d9b12ea-3683-4acd-a085-793225c4a658 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:02.527682 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9d9b12ea-3683-4acd-a085-793225c4a658 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:02.700718 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9d9b12ea-3683-4acd-a085-793225c4a658 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:02.715872 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9d9b12ea-3683-4acd-a085-793225c4a658 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1314 microversion: 2.1 time: 0.209538 May 10 14:02:02.725789 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 129/236] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:02 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:03.184052 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bbe0b3e6-9ba6-42f9-854d-697fd100ecee tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:03.184689 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bbe0b3e6-9ba6-42f9-854d-697fd100ecee tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:03.191729 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbe0b3e6-9ba6-42f9-854d-697fd100ecee tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:03.192207 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbe0b3e6-9ba6-42f9-854d-697fd100ecee tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:03.192965 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbe0b3e6-9ba6-42f9-854d-697fd100ecee tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:03.193395 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbe0b3e6-9ba6-42f9-854d-697fd100ecee tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:03.225876 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-23943027-3dee-4e81-baa9-e77131d48ed8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:03.227236 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-23943027-3dee-4e81-baa9-e77131d48ed8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:03.246517 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-23943027-3dee-4e81-baa9-e77131d48ed8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:03.254423 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-23943027-3dee-4e81-baa9-e77131d48ed8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:03.255536 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-23943027-3dee-4e81-baa9-e77131d48ed8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:03.255988 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-23943027-3dee-4e81-baa9-e77131d48ed8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:03.383867 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bbe0b3e6-9ba6-42f9-854d-697fd100ecee tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:03.396667 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bbe0b3e6-9ba6-42f9-854d-697fd100ecee tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:03.408612 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bbe0b3e6-9ba6-42f9-854d-697fd100ecee tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:03.409933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bbe0b3e6-9ba6-42f9-854d-697fd100ecee tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.234933 May 10 14:02:03.410685 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 108/237] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:03 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:03.481766 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-23943027-3dee-4e81-baa9-e77131d48ed8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:03.498142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-23943027-3dee-4e81-baa9-e77131d48ed8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.276116 May 10 14:02:03.499277 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 130/238] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:03 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:03.733183 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-56ccca5a-d528-490d-8a3f-c0cfd8607ec7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:03.733797 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-56ccca5a-d528-490d-8a3f-c0cfd8607ec7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:03.741440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-56ccca5a-d528-490d-8a3f-c0cfd8607ec7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:03.742163 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-56ccca5a-d528-490d-8a3f-c0cfd8607ec7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:03.744137 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-56ccca5a-d528-490d-8a3f-c0cfd8607ec7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:03.744877 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-56ccca5a-d528-490d-8a3f-c0cfd8607ec7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:04.051957 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-56ccca5a-d528-490d-8a3f-c0cfd8607ec7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:04.060934 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-56ccca5a-d528-490d-8a3f-c0cfd8607ec7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1314 microversion: 2.1 time: 0.331464 May 10 14:02:04.084485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 109/239] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:03 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:04.225357 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1226386207", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-379745293", "security_groups": [{"name": "tempest-secgroup-smoke-821776293"}], "block_device_mapping_v2": [{"uuid": "57425500-6067-4c08-b7aa-7e37ffa46c4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3ef3499-58c5-4573-b70a-3147dbe30f92"}]}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:04.430873 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b26e2a27-15b4-4a99-afd1-3f5c2576f54d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:04.432783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b26e2a27-15b4-4a99-afd1-3f5c2576f54d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:04.451553 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b26e2a27-15b4-4a99-afd1-3f5c2576f54d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:04.452031 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b26e2a27-15b4-4a99-afd1-3f5c2576f54d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:04.452840 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b26e2a27-15b4-4a99-afd1-3f5c2576f54d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:04.453394 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b26e2a27-15b4-4a99-afd1-3f5c2576f54d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:04.485374 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] validate_networks() for [('c3ef3499-58c5-4573-b70a-3147dbe30f92', None, None, None, None, None)] {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:02:04.614865 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b26e2a27-15b4-4a99-afd1-3f5c2576f54d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:04.626079 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b26e2a27-15b4-4a99-afd1-3f5c2576f54d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:04.628581 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b26e2a27-15b4-4a99-afd1-3f5c2576f54d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:04.630780 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b26e2a27-15b4-4a99-afd1-3f5c2576f54d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.205334 May 10 14:02:04.632090 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 110/240] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:04 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:02:04.638599 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-395336f0-53ca-45ec-b79a-49088c595507 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:04.639590 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-395336f0-53ca-45ec-b79a-49088c595507 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:04.647416 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-395336f0-53ca-45ec-b79a-49088c595507 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:04.648097 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-395336f0-53ca-45ec-b79a-49088c595507 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:04.649545 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-395336f0-53ca-45ec-b79a-49088c595507 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:04.650571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-395336f0-53ca-45ec-b79a-49088c595507 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:04.836634 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-395336f0-53ca-45ec-b79a-49088c595507 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:04.843950 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-395336f0-53ca-45ec-b79a-49088c595507 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.210578 May 10 14:02:04.844552 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 111/241] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:04 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:04.849457 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-96c0c5ed-2b89-41cb-95f2-a9891b1591a3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: .version_select at 0x7f5f7c273670>, body: {"keypair": {"name": "tempest-keypair-1584263563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEWvfMHb8YdkX1l3NAUbPUjnuw5f5m5ZgnwFxAPz8KzATxjDIQOcYafpXvyuZRNrdIo7Ie2LDtvaw93N+55RdaKyLqyevRaAQVUK+k73jSIfuOlRz8HpvTYY9kwUnSnoQ=="}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:04.863810 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-96c0c5ed-2b89-41cb-95f2-a9891b1591a3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:02:04.870069 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-96c0c5ed-2b89-41cb-95f2-a9891b1591a3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for user 8c563c6a229b4e619992ccfb0da1a748 and project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:02:04.910565 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-96c0c5ed-2b89-41cb-95f2-a9891b1591a3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064880 May 10 14:02:04.911518 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 112/242] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 14:02:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:05.087174 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:02:05.087604 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:02:05.088075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:02:05.088651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:02:05.089067 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:02:05.101222 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b440a2a0-ba51-4061-a548-d89fe4e052df tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:05.103009 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b440a2a0-ba51-4061-a548-d89fe4e052df tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:05.105563 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:05.106638 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:05.108203 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:05.109746 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:05.114814 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b440a2a0-ba51-4061-a548-d89fe4e052df tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:05.115400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b440a2a0-ba51-4061-a548-d89fe4e052df tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:05.116387 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b440a2a0-ba51-4061-a548-d89fe4e052df tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:05.116961 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b440a2a0-ba51-4061-a548-d89fe4e052df tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:05.206310 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Getting quotas for project 104740054c3a47ca8cc3cb262d975fd5. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:02:05.231773 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Getting quotas for user 9d87a4de3fbf4cbb9e21523634007629 and project 104740054c3a47ca8cc3cb262d975fd5. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:02:05.455871 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:02:05.458405 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57425500-6067-4c08-b7aa-7e37ffa46c4e',volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:02:05.792283 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d2e2a837-709d-40c3-b5f2-3988e857cb61 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.570616 May 10 14:02:05.794518 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 131/243] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:02:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:02:05.802442 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-71a90529-131e-464d-bcdc-98dba74ce31f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:05.804854 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-71a90529-131e-464d-bcdc-98dba74ce31f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:05.845209 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-71a90529-131e-464d-bcdc-98dba74ce31f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:05.848899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-71a90529-131e-464d-bcdc-98dba74ce31f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:05.851980 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-71a90529-131e-464d-bcdc-98dba74ce31f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:05.853587 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-71a90529-131e-464d-bcdc-98dba74ce31f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:06.020355 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b440a2a0-ba51-4061-a548-d89fe4e052df tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:06.032711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b440a2a0-ba51-4061-a548-d89fe4e052df tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1314 microversion: 2.1 time: 0.935429 May 10 14:02:06.034291 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 113/244] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:05 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:06.046098 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a34fe5b1-3116-4dc2-bc36-f436dedd78a1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:06.047443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a34fe5b1-3116-4dc2-bc36-f436dedd78a1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:06.173580 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a34fe5b1-3116-4dc2-bc36-f436dedd78a1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:06.181868 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a34fe5b1-3116-4dc2-bc36-f436dedd78a1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1094 microversion: 2.1 time: 0.146484 May 10 14:02:06.185582 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-71a90529-131e-464d-bcdc-98dba74ce31f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:06.186433 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 114/245] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:06 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1094 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:06.194978 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-71a90529-131e-464d-bcdc-98dba74ce31f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:06.202718 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-71a90529-131e-464d-bcdc-98dba74ce31f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:06.203595 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c9c0661f-131c-41d6-b2ac-38fbca66dea8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:06.204245 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c9c0661f-131c-41d6-b2ac-38fbca66dea8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:06.205424 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-71a90529-131e-464d-bcdc-98dba74ce31f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.409768 May 10 14:02:06.208494 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 132/246] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:05 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:06.216591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9c0661f-131c-41d6-b2ac-38fbca66dea8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:06.217405 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9c0661f-131c-41d6-b2ac-38fbca66dea8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:06.218427 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9c0661f-131c-41d6-b2ac-38fbca66dea8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:06.219075 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9c0661f-131c-41d6-b2ac-38fbca66dea8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:06.496667 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c9c0661f-131c-41d6-b2ac-38fbca66dea8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:06.505380 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c9c0661f-131c-41d6-b2ac-38fbca66dea8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.317868 May 10 14:02:06.505956 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 115/247] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:06 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:07.050349 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2a0e4358-1704-4669-8647-40f3a9463d92 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:07.051680 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2a0e4358-1704-4669-8647-40f3a9463d92 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:07.059981 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2a0e4358-1704-4669-8647-40f3a9463d92 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.061168 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2a0e4358-1704-4669-8647-40f3a9463d92 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.062751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2a0e4358-1704-4669-8647-40f3a9463d92 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.063499 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2a0e4358-1704-4669-8647-40f3a9463d92 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.204319 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4943db4d-b2f8-42ec-95ad-1f22d337e8fa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:07.205584 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4943db4d-b2f8-42ec-95ad-1f22d337e8fa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:07.218489 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4943db4d-b2f8-42ec-95ad-1f22d337e8fa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.220093 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4943db4d-b2f8-42ec-95ad-1f22d337e8fa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.222533 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4943db4d-b2f8-42ec-95ad-1f22d337e8fa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.223176 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4943db4d-b2f8-42ec-95ad-1f22d337e8fa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.347440 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2a0e4358-1704-4669-8647-40f3a9463d92 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:07.377088 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2a0e4358-1704-4669-8647-40f3a9463d92 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1314 microversion: 2.1 time: 0.331482 May 10 14:02:07.388606 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 133/248] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:07 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:07.398265 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-55b60547-76da-49c8-8052-a98f4b4bebdf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:07.399813 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-55b60547-76da-49c8-8052-a98f4b4bebdf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:07.415643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-55b60547-76da-49c8-8052-a98f4b4bebdf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.421794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-55b60547-76da-49c8-8052-a98f4b4bebdf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.423248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-55b60547-76da-49c8-8052-a98f4b4bebdf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.424227 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-55b60547-76da-49c8-8052-a98f4b4bebdf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.428630 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4943db4d-b2f8-42ec-95ad-1f22d337e8fa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:07.481098 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4943db4d-b2f8-42ec-95ad-1f22d337e8fa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1192 microversion: 2.1 time: 0.282156 May 10 14:02:07.481906 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 116/249] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:07 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1192 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:07.529193 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e130d27e-2314-4732-be7e-880e1f629bf0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:07.530047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e130d27e-2314-4732-be7e-880e1f629bf0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:07.558210 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e130d27e-2314-4732-be7e-880e1f629bf0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.560002 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e130d27e-2314-4732-be7e-880e1f629bf0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.561160 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e130d27e-2314-4732-be7e-880e1f629bf0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.561825 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e130d27e-2314-4732-be7e-880e1f629bf0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.787065 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-55b60547-76da-49c8-8052-a98f4b4bebdf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:07.805352 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-55b60547-76da-49c8-8052-a98f4b4bebdf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:07.806911 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-55b60547-76da-49c8-8052-a98f4b4bebdf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:07.808106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-55b60547-76da-49c8-8052-a98f4b4bebdf tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.417984 May 10 14:02:07.808718 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 134/250] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:07 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:07.816826 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-5c8eb430-8f27-4205-8677-cc5820adb4a7 req-81572154-9887-478f-9e24-dd30bec93ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f8c575-d141-465e-a1d6-0a588d798efc", "name": "network-vif-plugged", "status": "completed", "tag": "9b6ddffa-174d-4fdc-9944-6f473aa96b81"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:07.830484 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-5c8eb430-8f27-4205-8677-cc5820adb4a7 req-81572154-9887-478f-9e24-dd30bec93ed1 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.830929 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-5c8eb430-8f27-4205-8677-cc5820adb4a7 req-81572154-9887-478f-9e24-dd30bec93ed1 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.844424 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-5c8eb430-8f27-4205-8677-cc5820adb4a7 req-81572154-9887-478f-9e24-dd30bec93ed1 service nova] Creating event network-vif-plugged:9b6ddffa-174d-4fdc-9944-6f473aa96b81 for instance 69f8c575-d141-465e-a1d6-0a588d798efc on hv-cinder-84067 May 10 14:02:07.850533 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-5c8eb430-8f27-4205-8677-cc5820adb4a7 req-81572154-9887-478f-9e24-dd30bec93ed1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040629 May 10 14:02:07.851293 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 135/251] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:07.859508 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2025509174", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c9ceeee-200d-4bc2-b027-788cdb69321a"}], "security_groups": [{"name": "tempest-securitygroup--476579658"}], "key_name": "tempest-keypair-1584263563", "user_data": "}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:08.025674 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] validate_networks() for [('2c9ceeee-200d-4bc2-b027-788cdb69321a', None, None, None, None, None)] {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:02:08.202505 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e130d27e-2314-4732-be7e-880e1f629bf0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:08.212749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e130d27e-2314-4732-be7e-880e1f629bf0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1502 microversion: 2.1 time: 0.689791 May 10 14:02:08.213850 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 117/252] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:07 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1502 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:08.250946 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-66458b85-750b-4be7-b27d-2e11512a7236 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6cfa43b-6b42-42b2-84f6-3a34c36294b0"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:08.250946 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-66458b85-750b-4be7-b27d-2e11512a7236 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:08.279502 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-66458b85-750b-4be7-b27d-2e11512a7236 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.281789 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-66458b85-750b-4be7-b27d-2e11512a7236 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.284410 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-66458b85-750b-4be7-b27d-2e11512a7236 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.288702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-66458b85-750b-4be7-b27d-2e11512a7236 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.327593 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-66458b85-750b-4be7-b27d-2e11512a7236 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] HTTP exception thrown: Cannot 'attach_volume' instance 54be9a2c-c327-4249-ba65-0fc49162bac7 while it is in vm_state rescued May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-66458b85-750b-4be7-b27d-2e11512a7236 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Request method failure captured: May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: POST /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7/os-volume_attachments HTTP/1.1 May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 74 May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_xDu6JK8pwUvXha8KU8vHpKnPJ5AHhm1By_XEE5j72JnoFzaYxegH6ZsuxN4FWA1raNtM_ROxaWfY0nbamU8BT7VWF1Y7WMNmjHep8IOoIxRuQKI3XGxdDGrNRZkarxHVxP2Sbt7uY3g2tkENQuSC7H9HTviVk1BNO3aP-ni1o7Qs May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 368287ad726146f88559c73a86e4b26d May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:02:08.331214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:02:08.332837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/368287ad726146f88559c73a86e4b26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_368287ad726146f88559c73a86e4b26d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/368287ad726146f88559c73a86e4b26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/368287ad726146f88559c73a86e4b26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:02:08.332837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:02:08.332837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 368287ad726146f88559c73a86e4b26d May 10 14:02:08.332837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:02:08.332837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-ServerRescueNegativeTestJSON-1855127385-project May 10 14:02:08.332837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:02:08.332837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:02:08.332837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: bd14de0fd51c4fd89d9875b9c47100cc May 10 14:02:08.332837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855127385-project May 10 14:02:08.332837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: May 10 14:02:08.332837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {"volumeAttachment": {"volumeId": "f6cfa43b-6b42-42b2-84f6-3a34c36294b0"}} May 10 14:02:08.332837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Cannot 'attach_volume' instance 54be9a2c-c327-4249-ba65-0fc49162bac7 while it is in vm_state rescued May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'server_id': '54be9a2c-c327-4249-ba65-0fc49162bac7', 'body': {'volumeAttachment': {'volumeId': 'f6cfa43b-6b42-42b2-84f6-3a34c36294b0'}}} May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54be9a2c-c327-4249-ba65-0fc49162bac7 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:02:08.333603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 54be9a2c-c327-4249-ba65-0fc49162bac7 while it is in vm_state rescued May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:02:08.334702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:02:08.335730 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:02:08.335730 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:02:08.335730 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 54be9a2c-c327-4249-ba65-0fc49162bac7 while it is in vm_state rescued May 10 14:02:08.335730 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:02:08.339190 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-66458b85-750b-4be7-b27d-2e11512a7236 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Returning 409 to user: Cannot 'attach_volume' instance 54be9a2c-c327-4249-ba65-0fc49162bac7 while it is in vm_state rescued {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:02:08.341170 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-66458b85-750b-4be7-b27d-2e11512a7236 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "POST /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.106543 May 10 14:02:08.343785 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 118/253] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:02:08 2022] POST /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7/os-volume_attachments => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 14:02:08.356762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a874a00d-b81c-415c-92b9-d5bdc98fbef1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:08.358481 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a874a00d-b81c-415c-92b9-d5bdc98fbef1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:08.372571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a874a00d-b81c-415c-92b9-d5bdc98fbef1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.373309 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a874a00d-b81c-415c-92b9-d5bdc98fbef1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.375246 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a874a00d-b81c-415c-92b9-d5bdc98fbef1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.376972 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a874a00d-b81c-415c-92b9-d5bdc98fbef1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.494252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a874a00d-b81c-415c-92b9-d5bdc98fbef1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "POST /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7/action" status: 202 len: 0 microversion: 2.1 time: 0.145629 May 10 14:02:08.495915 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 119/254] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:02:08 2022] POST /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:02:08.505016 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-32d6d157-47dc-47a8-8ed6-09afd62229c9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:08.510347 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-32d6d157-47dc-47a8-8ed6-09afd62229c9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:08.520384 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-32d6d157-47dc-47a8-8ed6-09afd62229c9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.521419 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-32d6d157-47dc-47a8-8ed6-09afd62229c9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.522671 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-32d6d157-47dc-47a8-8ed6-09afd62229c9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.523632 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-32d6d157-47dc-47a8-8ed6-09afd62229c9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.676053 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:02:08.677232 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:02:08.678047 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:02:08.678761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:02:08.679396 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:02:08.693462 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.694164 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.695243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.695920 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.717841 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:02:08.722352 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for user 8c563c6a229b4e619992ccfb0da1a748 and project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:02:08.735970 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:02:08.738437 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:02:08.804144 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-99959232-dcfd-46fa-ab6b-91e56a520e82 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.950703 May 10 14:02:08.805949 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 136/255] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:02:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:02:08.815281 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8e1d5b67-cd22-451f-883d-b834a43e7f11 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:08.815889 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8e1d5b67-cd22-451f-883d-b834a43e7f11 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:08.825958 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8e1d5b67-cd22-451f-883d-b834a43e7f11 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.826417 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8e1d5b67-cd22-451f-883d-b834a43e7f11 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.827808 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8e1d5b67-cd22-451f-883d-b834a43e7f11 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.828331 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8e1d5b67-cd22-451f-883d-b834a43e7f11 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:09.018742 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-32d6d157-47dc-47a8-8ed6-09afd62229c9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:09.040643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-32d6d157-47dc-47a8-8ed6-09afd62229c9 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1314 microversion: 2.1 time: 0.542954 May 10 14:02:09.041201 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 120/256] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:08 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:09.050235 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8e1d5b67-cd22-451f-883d-b834a43e7f11 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:09.053674 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8e1d5b67-cd22-451f-883d-b834a43e7f11 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1510 microversion: 2.1 time: 0.246512 May 10 14:02:09.060741 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 137/257] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:08 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:09.064664 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-70129532-baba-404d-9809-b824ff3afbaa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:09.065684 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-70129532-baba-404d-9809-b824ff3afbaa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:09.072064 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-58d65319-65c0-4d43-8822-c85b7ee71630 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:09.072623 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-58d65319-65c0-4d43-8822-c85b7ee71630 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:09.080572 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-70129532-baba-404d-9809-b824ff3afbaa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:09.081019 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-70129532-baba-404d-9809-b824ff3afbaa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:09.081800 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-70129532-baba-404d-9809-b824ff3afbaa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:09.084873 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-70129532-baba-404d-9809-b824ff3afbaa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:09.172854 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-58d65319-65c0-4d43-8822-c85b7ee71630 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:09.180586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-58d65319-65c0-4d43-8822-c85b7ee71630 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1242 microversion: 2.1 time: 0.118439 May 10 14:02:09.182765 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 138/258] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:09 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:09.186319 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-70129532-baba-404d-9809-b824ff3afbaa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:09.194199 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-70129532-baba-404d-9809-b824ff3afbaa tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1210 microversion: 2.1 time: 0.136692 May 10 14:02:09.194996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 121/259] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:09 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1210 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:09.195092 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-19d60f57-74eb-4b44-9531-da9ab812cc4f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:09.195676 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-19d60f57-74eb-4b44-9531-da9ab812cc4f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:09.213183 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-19d60f57-74eb-4b44-9531-da9ab812cc4f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:09.214216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-19d60f57-74eb-4b44-9531-da9ab812cc4f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:09.215243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-19d60f57-74eb-4b44-9531-da9ab812cc4f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:09.215893 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-19d60f57-74eb-4b44-9531-da9ab812cc4f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:09.388861 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-19d60f57-74eb-4b44-9531-da9ab812cc4f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:09.397247 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-19d60f57-74eb-4b44-9531-da9ab812cc4f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:09.399934 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-19d60f57-74eb-4b44-9531-da9ab812cc4f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:09.401138 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-19d60f57-74eb-4b44-9531-da9ab812cc4f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.216239 May 10 14:02:09.401707 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 139/260] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:09 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:10.056604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3d1a728b-d91a-4879-8ac1-af55234a1b47 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:10.057206 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-3d1a728b-d91a-4879-8ac1-af55234a1b47 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:10.067309 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3d1a728b-d91a-4879-8ac1-af55234a1b47 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.067759 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3d1a728b-d91a-4879-8ac1-af55234a1b47 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.069334 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3d1a728b-d91a-4879-8ac1-af55234a1b47 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.071638 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3d1a728b-d91a-4879-8ac1-af55234a1b47 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.077130 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-00bd554e-f5ec-4000-ab0b-f0084a52c797 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:10.083873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-00bd554e-f5ec-4000-ab0b-f0084a52c797 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:10.095936 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-00bd554e-f5ec-4000-ab0b-f0084a52c797 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.096681 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-00bd554e-f5ec-4000-ab0b-f0084a52c797 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.097687 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-00bd554e-f5ec-4000-ab0b-f0084a52c797 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.098358 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-00bd554e-f5ec-4000-ab0b-f0084a52c797 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.362578 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3d1a728b-d91a-4879-8ac1-af55234a1b47 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:10.372785 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3d1a728b-d91a-4879-8ac1-af55234a1b47 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1314 microversion: 2.1 time: 0.318738 May 10 14:02:10.373761 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 122/261] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:10 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:10.396622 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bb690136-d970-494d-8479-48dcd25ab682 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:10.397536 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bb690136-d970-494d-8479-48dcd25ab682 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:10.405680 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bb690136-d970-494d-8479-48dcd25ab682 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.406138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bb690136-d970-494d-8479-48dcd25ab682 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.407802 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bb690136-d970-494d-8479-48dcd25ab682 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.408902 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bb690136-d970-494d-8479-48dcd25ab682 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.416837 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-00bd554e-f5ec-4000-ab0b-f0084a52c797 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:10.425757 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-00bd554e-f5ec-4000-ab0b-f0084a52c797 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1510 microversion: 2.1 time: 0.353845 May 10 14:02:10.427734 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 140/262] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:10 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:10.436996 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1d185480-050c-43ea-a4f0-42d00853ae6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:10.440006 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1d185480-050c-43ea-a4f0-42d00853ae6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:10.458271 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d185480-050c-43ea-a4f0-42d00853ae6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.458741 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d185480-050c-43ea-a4f0-42d00853ae6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.459910 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d185480-050c-43ea-a4f0-42d00853ae6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.460539 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d185480-050c-43ea-a4f0-42d00853ae6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.535993 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bb690136-d970-494d-8479-48dcd25ab682 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:10.545767 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bb690136-d970-494d-8479-48dcd25ab682 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1294 microversion: 2.1 time: 0.170782 May 10 14:02:10.546854 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 123/263] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:10 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1294 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:10.564086 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a6c61e69-0dc9-4656-b053-9277b11367d9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:10.565097 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a6c61e69-0dc9-4656-b053-9277b11367d9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:10.576115 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a6c61e69-0dc9-4656-b053-9277b11367d9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.587090 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a6c61e69-0dc9-4656-b053-9277b11367d9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.590673 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a6c61e69-0dc9-4656-b053-9277b11367d9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.591428 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a6c61e69-0dc9-4656-b053-9277b11367d9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.647066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1d185480-050c-43ea-a4f0-42d00853ae6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:10.657382 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1d185480-050c-43ea-a4f0-42d00853ae6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1277 microversion: 2.1 time: 0.223925 May 10 14:02:10.658361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 141/264] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:10 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:10.765380 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a6c61e69-0dc9-4656-b053-9277b11367d9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:10.774655 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a6c61e69-0dc9-4656-b053-9277b11367d9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:10.776340 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a6c61e69-0dc9-4656-b053-9277b11367d9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:10.777663 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a6c61e69-0dc9-4656-b053-9277b11367d9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.229439 May 10 14:02:10.778802 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 124/265] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:10 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:11.399857 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-881e5595-dac2-43b3-bedf-a31d40f33b98 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:11.400661 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-881e5595-dac2-43b3-bedf-a31d40f33b98 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:11.408785 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-881e5595-dac2-43b3-bedf-a31d40f33b98 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.409830 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-881e5595-dac2-43b3-bedf-a31d40f33b98 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.410375 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-881e5595-dac2-43b3-bedf-a31d40f33b98 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.410879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-881e5595-dac2-43b3-bedf-a31d40f33b98 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.444546 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b5e14a75-f4af-4879-8474-eb5cf83c671e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:11.446296 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b5e14a75-f4af-4879-8474-eb5cf83c671e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:11.458820 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b5e14a75-f4af-4879-8474-eb5cf83c671e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.461358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b5e14a75-f4af-4879-8474-eb5cf83c671e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.462591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b5e14a75-f4af-4879-8474-eb5cf83c671e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.463206 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b5e14a75-f4af-4879-8474-eb5cf83c671e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.671449 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-881e5595-dac2-43b3-bedf-a31d40f33b98 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:11.681196 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-881e5595-dac2-43b3-bedf-a31d40f33b98 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1464 microversion: 2.1 time: 0.294561 May 10 14:02:11.682153 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 142/266] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:11 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1464 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:11.688558 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9ec54fc6-12ac-4d3c-9d07-c86d6291eb6e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:11.689620 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9ec54fc6-12ac-4d3c-9d07-c86d6291eb6e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:11.697651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9ec54fc6-12ac-4d3c-9d07-c86d6291eb6e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.698120 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9ec54fc6-12ac-4d3c-9d07-c86d6291eb6e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.698956 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9ec54fc6-12ac-4d3c-9d07-c86d6291eb6e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.699787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9ec54fc6-12ac-4d3c-9d07-c86d6291eb6e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.812871 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9ec54fc6-12ac-4d3c-9d07-c86d6291eb6e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:11.826209 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9ec54fc6-12ac-4d3c-9d07-c86d6291eb6e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1312 microversion: 2.1 time: 0.142418 May 10 14:02:11.827024 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 143/267] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:11 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1312 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:11.863704 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7fd72df6-dc3e-4afb-bbd1-9d34fae8359e tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:11.865941 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7fd72df6-dc3e-4afb-bbd1-9d34fae8359e tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:11.876745 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b5e14a75-f4af-4879-8474-eb5cf83c671e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:11.878863 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7fd72df6-dc3e-4afb-bbd1-9d34fae8359e tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.879317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7fd72df6-dc3e-4afb-bbd1-9d34fae8359e tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.886013 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b5e14a75-f4af-4879-8474-eb5cf83c671e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1510 microversion: 2.1 time: 0.446533 May 10 14:02:11.886237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7fd72df6-dc3e-4afb-bbd1-9d34fae8359e tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.886699 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7fd72df6-dc3e-4afb-bbd1-9d34fae8359e tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.887642 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 125/268] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:11 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1510 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:11.902278 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bf37cd8f-4a93-4851-aacf-14ad8e97efce tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:11.904573 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bf37cd8f-4a93-4851-aacf-14ad8e97efce tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:11.911380 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf37cd8f-4a93-4851-aacf-14ad8e97efce tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.911818 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf37cd8f-4a93-4851-aacf-14ad8e97efce tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.917168 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf37cd8f-4a93-4851-aacf-14ad8e97efce tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.917618 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf37cd8f-4a93-4851-aacf-14ad8e97efce tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.973383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bf37cd8f-4a93-4851-aacf-14ad8e97efce tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Going to try to terminate instance {{(pid=117153) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:02:12.160212 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7fd72df6-dc3e-4afb-bbd1-9d34fae8359e tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:12.185003 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7fd72df6-dc3e-4afb-bbd1-9d34fae8359e tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1277 microversion: 2.1 time: 0.333771 May 10 14:02:12.185003 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 144/269] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:11 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1277 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:12.185003 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7c75adc8-552a-467a-a93d-66842bd22eb2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:12.185003 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7c75adc8-552a-467a-a93d-66842bd22eb2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:12.214612 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7c75adc8-552a-467a-a93d-66842bd22eb2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.215073 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7c75adc8-552a-467a-a93d-66842bd22eb2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.215887 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7c75adc8-552a-467a-a93d-66842bd22eb2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.216374 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7c75adc8-552a-467a-a93d-66842bd22eb2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.231043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bf37cd8f-4a93-4851-aacf-14ad8e97efce tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "DELETE /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 204 len: 0 microversion: 2.1 time: 0.342299 May 10 14:02:12.234984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 126/270] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:02:11 2022] DELETE /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:02:12.251910 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c060d200-8ffd-4918-a65b-236fcf2f3ac0 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:12.252364 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c060d200-8ffd-4918-a65b-236fcf2f3ac0 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:12.312995 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c060d200-8ffd-4918-a65b-236fcf2f3ac0 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.313585 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c060d200-8ffd-4918-a65b-236fcf2f3ac0 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.314473 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c060d200-8ffd-4918-a65b-236fcf2f3ac0 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.315002 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c060d200-8ffd-4918-a65b-236fcf2f3ac0 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.430491 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7c75adc8-552a-467a-a93d-66842bd22eb2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:12.440932 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7c75adc8-552a-467a-a93d-66842bd22eb2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:12.442630 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7c75adc8-552a-467a-a93d-66842bd22eb2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:12.444275 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7c75adc8-552a-467a-a93d-66842bd22eb2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.270030 May 10 14:02:12.470106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 145/271] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:12 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:12.484231 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-f1127089-4edf-4c8d-83ea-1e7d53d05ef6 req-aa24ecbe-4d56-4caf-8170-b0c4a19497ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2288a3f8-70db-4951-acaf-f839a42ed73b", "tag": "ec56af2f-6e36-458b-8cbf-61f578a6cae0"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:12.495777 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-f1127089-4edf-4c8d-83ea-1e7d53d05ef6 req-aa24ecbe-4d56-4caf-8170-b0c4a19497ec service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.496419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-f1127089-4edf-4c8d-83ea-1e7d53d05ef6 req-aa24ecbe-4d56-4caf-8170-b0c4a19497ec service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.514259 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-f1127089-4edf-4c8d-83ea-1e7d53d05ef6 req-aa24ecbe-4d56-4caf-8170-b0c4a19497ec service nova] Creating event network-changed:ec56af2f-6e36-458b-8cbf-61f578a6cae0 for instance 2288a3f8-70db-4951-acaf-f839a42ed73b on hv-cinder-84067 May 10 14:02:12.519934 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-f1127089-4edf-4c8d-83ea-1e7d53d05ef6 req-aa24ecbe-4d56-4caf-8170-b0c4a19497ec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048524 May 10 14:02:12.522123 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 146/272] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:12.590775 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c060d200-8ffd-4918-a65b-236fcf2f3ac0 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:12.598329 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c060d200-8ffd-4918-a65b-236fcf2f3ac0 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1470 microversion: 2.1 time: 0.362064 May 10 14:02:12.599797 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 127/273] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:12 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1470 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:12.844747 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1721cc4b-fa68-45b4-ae9c-60630a338ad3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:12.846194 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1721cc4b-fa68-45b4-ae9c-60630a338ad3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:12.853312 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1721cc4b-fa68-45b4-ae9c-60630a338ad3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.854075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1721cc4b-fa68-45b4-ae9c-60630a338ad3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.855292 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1721cc4b-fa68-45b4-ae9c-60630a338ad3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.855950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1721cc4b-fa68-45b4-ae9c-60630a338ad3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.904554 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fa4177ff-9085-4fd3-9718-278f575080ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:12.905472 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fa4177ff-9085-4fd3-9718-278f575080ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:12.915468 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fa4177ff-9085-4fd3-9718-278f575080ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.916100 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fa4177ff-9085-4fd3-9718-278f575080ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.917076 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fa4177ff-9085-4fd3-9718-278f575080ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.917706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fa4177ff-9085-4fd3-9718-278f575080ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.944410 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1721cc4b-fa68-45b4-ae9c-60630a338ad3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:12.953202 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1721cc4b-fa68-45b4-ae9c-60630a338ad3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1312 microversion: 2.1 time: 0.113561 May 10 14:02:12.963294 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 147/274] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:12 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1312 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:13.105342 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-fa4177ff-9085-4fd3-9718-278f575080ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:13.115367 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fa4177ff-9085-4fd3-9718-278f575080ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1510 microversion: 2.1 time: 0.215563 May 10 14:02:13.126759 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 128/275] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:12 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:13.127842 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8999ce3e-525f-49b8-a80a-94d7fc3f6ac6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Action: 'create', calling method: .version_select at 0x7f5f7c46dc10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1111046983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIthYfg8JPEhF50QtjcdB5q+wKCVjqg55fELx0IxyB8OP35mF4ppiwn4XsQIbh9taMNJlaCH4mdBbdgm+XnTHoDyN7fsyf5FlvVcZQPENTHvwnVu+j21abbPxT69X37DVQ=="}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:13.141275 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-8999ce3e-525f-49b8-a80a-94d7fc3f6ac6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Getting quotas for project b1e759f08bf04eeabbbc1b14bca8a169. Resources: {'key_pairs'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:02:13.145040 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-8999ce3e-525f-49b8-a80a-94d7fc3f6ac6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Getting quotas for user c4f57917c86244c2baecd9d795c502c4 and project b1e759f08bf04eeabbbc1b14bca8a169. Resources: {'key_pairs'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:02:13.166914 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8999ce3e-525f-49b8-a80a-94d7fc3f6ac6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.042831 May 10 14:02:13.167602 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 148/276] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 14:02:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:02:13.180937 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0a7ba9ad-51c4-4fd2-a203-2e024f1394c6 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:13.181857 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0a7ba9ad-51c4-4fd2-a203-2e024f1394c6 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:13.187942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0a7ba9ad-51c4-4fd2-a203-2e024f1394c6 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.188670 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0a7ba9ad-51c4-4fd2-a203-2e024f1394c6 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.189788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0a7ba9ad-51c4-4fd2-a203-2e024f1394c6 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.190444 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0a7ba9ad-51c4-4fd2-a203-2e024f1394c6 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.275004 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-956993913", "imageRef": "e05639f8-4afc-48d2-b850-46f5ae9dfcb8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1111046983", "networks": [{"uuid": "4a14d7cf-9974-4ffa-b6dc-1f38cf5a3a92"}]}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:13.334934 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] validate_networks() for [('4a14d7cf-9974-4ffa-b6dc-1f38cf5a3a92', None, None, None, None, None)] {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:02:13.338625 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0a7ba9ad-51c4-4fd2-a203-2e024f1394c6 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:13.346249 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0a7ba9ad-51c4-4fd2-a203-2e024f1394c6 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1277 microversion: 2.1 time: 0.170634 May 10 14:02:13.356424 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 129/277] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:13 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:13.466807 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-be47240a-3ecf-4ff9-85e5-cabe10fab60a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:13.468155 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-be47240a-3ecf-4ff9-85e5-cabe10fab60a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:13.475487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-be47240a-3ecf-4ff9-85e5-cabe10fab60a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.476537 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-be47240a-3ecf-4ff9-85e5-cabe10fab60a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.477890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-be47240a-3ecf-4ff9-85e5-cabe10fab60a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.478553 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-be47240a-3ecf-4ff9-85e5-cabe10fab60a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.613201 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-be47240a-3ecf-4ff9-85e5-cabe10fab60a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:13.621623 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-be47240a-3ecf-4ff9-85e5-cabe10fab60a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:13.623117 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-be47240a-3ecf-4ff9-85e5-cabe10fab60a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:13.624297 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-be47240a-3ecf-4ff9-85e5-cabe10fab60a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.164712 May 10 14:02:13.624854 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 130/278] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:13 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:13.629265 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-228a02f1-06a3-445b-9e24-10a0a1589d70 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:13.629857 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-228a02f1-06a3-445b-9e24-10a0a1589d70 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:13.635989 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-228a02f1-06a3-445b-9e24-10a0a1589d70 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.636464 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-228a02f1-06a3-445b-9e24-10a0a1589d70 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.637227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-228a02f1-06a3-445b-9e24-10a0a1589d70 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.637659 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-228a02f1-06a3-445b-9e24-10a0a1589d70 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.784030 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-228a02f1-06a3-445b-9e24-10a0a1589d70 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:13.794878 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-228a02f1-06a3-445b-9e24-10a0a1589d70 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1470 microversion: 2.1 time: 0.169038 May 10 14:02:13.795667 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 131/279] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:13 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:13.798586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:02:13.799088 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:02:13.799770 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:02:13.800388 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:02:13.800813 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:02:13.810218 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.810668 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.811473 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.811910 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.827952 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Getting quotas for project b1e759f08bf04eeabbbc1b14bca8a169. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:02:13.831869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Getting quotas for user c4f57917c86244c2baecd9d795c502c4 and project b1e759f08bf04eeabbbc1b14bca8a169. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:02:13.842568 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:02:13.844753 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e05639f8-4afc-48d2-b850-46f5ae9dfcb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:02:13.891025 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-bb2c9d46-1b91-4a59-8dd2-80e251827b8f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619895 May 10 14:02:13.891663 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 149/280] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:02:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:02:13.902040 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-cbee6d12-c606-4945-93e3-050c09dc4794 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:13.902655 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-cbee6d12-c606-4945-93e3-050c09dc4794 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:13.960792 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-cbee6d12-c606-4945-93e3-050c09dc4794 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:13.967596 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-cbee6d12-c606-4945-93e3-050c09dc4794 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1258 microversion: 2.1 time: 0.069494 May 10 14:02:13.968454 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 132/281] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:13 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:13.969932 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7f375334-7ebf-4aa6-ad7a-38c1a684d49b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:13.970542 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7f375334-7ebf-4aa6-ad7a-38c1a684d49b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:13.977773 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7f375334-7ebf-4aa6-ad7a-38c1a684d49b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.978215 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7f375334-7ebf-4aa6-ad7a-38c1a684d49b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.979025 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7f375334-7ebf-4aa6-ad7a-38c1a684d49b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.979457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7f375334-7ebf-4aa6-ad7a-38c1a684d49b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.040257 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7f375334-7ebf-4aa6-ad7a-38c1a684d49b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:14.047816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7f375334-7ebf-4aa6-ad7a-38c1a684d49b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1300 microversion: 2.1 time: 0.082024 May 10 14:02:14.048411 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 150/282] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:13 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1300 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:14.133955 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e217ca7f-6396-40a8-9afa-fe9b8afb3871 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:14.134635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e217ca7f-6396-40a8-9afa-fe9b8afb3871 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:14.140304 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e217ca7f-6396-40a8-9afa-fe9b8afb3871 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.140747 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e217ca7f-6396-40a8-9afa-fe9b8afb3871 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.141503 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e217ca7f-6396-40a8-9afa-fe9b8afb3871 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.141935 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e217ca7f-6396-40a8-9afa-fe9b8afb3871 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.272436 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e217ca7f-6396-40a8-9afa-fe9b8afb3871 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:14.281131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e217ca7f-6396-40a8-9afa-fe9b8afb3871 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1510 microversion: 2.1 time: 0.151570 May 10 14:02:14.281721 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 133/283] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:14 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:14.362610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5d358e13-3d36-4a4a-b8dd-f71221b81da9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:14.363212 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5d358e13-3d36-4a4a-b8dd-f71221b81da9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:14.369632 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5d358e13-3d36-4a4a-b8dd-f71221b81da9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.370060 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5d358e13-3d36-4a4a-b8dd-f71221b81da9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.370817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5d358e13-3d36-4a4a-b8dd-f71221b81da9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.371250 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5d358e13-3d36-4a4a-b8dd-f71221b81da9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.512284 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5d358e13-3d36-4a4a-b8dd-f71221b81da9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:14.520217 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5d358e13-3d36-4a4a-b8dd-f71221b81da9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1277 microversion: 2.1 time: 0.161277 May 10 14:02:14.520821 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 151/284] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:14 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:14.643099 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-30b0749d-2344-4959-97ff-c56ed86950de tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:14.645202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-30b0749d-2344-4959-97ff-c56ed86950de tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:14.653389 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-30b0749d-2344-4959-97ff-c56ed86950de tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.654101 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-30b0749d-2344-4959-97ff-c56ed86950de tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.655093 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-30b0749d-2344-4959-97ff-c56ed86950de tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.655651 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-30b0749d-2344-4959-97ff-c56ed86950de tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.785120 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-30b0749d-2344-4959-97ff-c56ed86950de tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:14.792777 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-30b0749d-2344-4959-97ff-c56ed86950de tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:14.794286 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-30b0749d-2344-4959-97ff-c56ed86950de tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:14.795466 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-30b0749d-2344-4959-97ff-c56ed86950de tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.156555 May 10 14:02:14.796027 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 134/285] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:14 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:14.811857 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-6b7f7fc1-f30f-4da6-923c-94d5c109ae13 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:14.812472 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-6b7f7fc1-f30f-4da6-923c-94d5c109ae13 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:14.818246 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6b7f7fc1-f30f-4da6-923c-94d5c109ae13 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.818686 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6b7f7fc1-f30f-4da6-923c-94d5c109ae13 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.819440 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6b7f7fc1-f30f-4da6-923c-94d5c109ae13 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.819875 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6b7f7fc1-f30f-4da6-923c-94d5c109ae13 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.947717 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-6b7f7fc1-f30f-4da6-923c-94d5c109ae13 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:14.954982 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-6b7f7fc1-f30f-4da6-923c-94d5c109ae13 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1470 microversion: 2.1 time: 0.146962 May 10 14:02:14.955551 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 152/286] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:14 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:14.985148 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9e01cae1-8fbe-45eb-9d3c-e42cf06f58ab tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:14.985704 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9e01cae1-8fbe-45eb-9d3c-e42cf06f58ab tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:14.991584 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e01cae1-8fbe-45eb-9d3c-e42cf06f58ab tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.992091 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e01cae1-8fbe-45eb-9d3c-e42cf06f58ab tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.992898 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e01cae1-8fbe-45eb-9d3c-e42cf06f58ab tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.993340 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e01cae1-8fbe-45eb-9d3c-e42cf06f58ab tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.057594 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9e01cae1-8fbe-45eb-9d3c-e42cf06f58ab tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:15.065311 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9e01cae1-8fbe-45eb-9d3c-e42cf06f58ab tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1262 microversion: 2.1 time: 0.083794 May 10 14:02:15.065890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 135/287] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:14 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:15.069946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2ecfee26-b560-4681-bd9e-7889b328223c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:15.070564 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2ecfee26-b560-4681-bd9e-7889b328223c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:15.076398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ecfee26-b560-4681-bd9e-7889b328223c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.076869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ecfee26-b560-4681-bd9e-7889b328223c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.077606 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ecfee26-b560-4681-bd9e-7889b328223c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.078039 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ecfee26-b560-4681-bd9e-7889b328223c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.140387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2ecfee26-b560-4681-bd9e-7889b328223c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:15.147746 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2ecfee26-b560-4681-bd9e-7889b328223c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1300 microversion: 2.1 time: 0.081597 May 10 14:02:15.148857 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 153/288] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:15 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1300 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:15.298286 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7508e287-5710-4d40-8043-eed13de614c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:15.298845 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7508e287-5710-4d40-8043-eed13de614c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:15.305589 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7508e287-5710-4d40-8043-eed13de614c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.306040 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7508e287-5710-4d40-8043-eed13de614c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.306807 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7508e287-5710-4d40-8043-eed13de614c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.307245 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7508e287-5710-4d40-8043-eed13de614c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.431634 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7508e287-5710-4d40-8043-eed13de614c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:15.438805 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7508e287-5710-4d40-8043-eed13de614c0 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1510 microversion: 2.1 time: 0.144474 May 10 14:02:15.439477 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 136/289] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:15 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:15.537133 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e40f0d36-1cf8-49d6-a17e-06bdc45bb642 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:15.537747 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e40f0d36-1cf8-49d6-a17e-06bdc45bb642 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:15.544495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e40f0d36-1cf8-49d6-a17e-06bdc45bb642 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.544947 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e40f0d36-1cf8-49d6-a17e-06bdc45bb642 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.545707 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e40f0d36-1cf8-49d6-a17e-06bdc45bb642 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.546145 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e40f0d36-1cf8-49d6-a17e-06bdc45bb642 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.670819 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e40f0d36-1cf8-49d6-a17e-06bdc45bb642 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:15.679093 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e40f0d36-1cf8-49d6-a17e-06bdc45bb642 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1277 microversion: 2.1 time: 0.145734 May 10 14:02:15.679941 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 154/290] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:15 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:15.813383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0d4d0ac5-d3a3-4477-9ca4-2156f62510c9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:15.813995 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0d4d0ac5-d3a3-4477-9ca4-2156f62510c9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:15.819880 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d4d0ac5-d3a3-4477-9ca4-2156f62510c9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.820938 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d4d0ac5-d3a3-4477-9ca4-2156f62510c9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.821705 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d4d0ac5-d3a3-4477-9ca4-2156f62510c9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.822142 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d4d0ac5-d3a3-4477-9ca4-2156f62510c9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.947476 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0d4d0ac5-d3a3-4477-9ca4-2156f62510c9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:15.955322 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0d4d0ac5-d3a3-4477-9ca4-2156f62510c9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:15.956857 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0d4d0ac5-d3a3-4477-9ca4-2156f62510c9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:15.957992 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0d4d0ac5-d3a3-4477-9ca4-2156f62510c9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.148585 May 10 14:02:15.958546 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 137/291] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:15 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:15.972245 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-faf0b61e-c0ac-4b9d-b99e-938c636978fc tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:15.972858 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-faf0b61e-c0ac-4b9d-b99e-938c636978fc tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:15.978583 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-faf0b61e-c0ac-4b9d-b99e-938c636978fc tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.979022 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-faf0b61e-c0ac-4b9d-b99e-938c636978fc tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.979773 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-faf0b61e-c0ac-4b9d-b99e-938c636978fc tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.980227 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-faf0b61e-c0ac-4b9d-b99e-938c636978fc tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.081951 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bad1ec44-6099-4937-87bd-ac2d08fca194 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:16.082558 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bad1ec44-6099-4937-87bd-ac2d08fca194 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:16.088469 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bad1ec44-6099-4937-87bd-ac2d08fca194 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.088916 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bad1ec44-6099-4937-87bd-ac2d08fca194 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.089679 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bad1ec44-6099-4937-87bd-ac2d08fca194 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.090111 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bad1ec44-6099-4937-87bd-ac2d08fca194 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.110650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-faf0b61e-c0ac-4b9d-b99e-938c636978fc tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:16.118483 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-faf0b61e-c0ac-4b9d-b99e-938c636978fc tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1470 microversion: 2.1 time: 0.150040 May 10 14:02:16.119067 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 155/292] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:15 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:16.149417 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bad1ec44-6099-4937-87bd-ac2d08fca194 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:16.156419 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bad1ec44-6099-4937-87bd-ac2d08fca194 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1262 microversion: 2.1 time: 0.078310 May 10 14:02:16.156986 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 138/293] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:16 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1262 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:16.165443 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8f0d821a-7297-4399-8235-491046105383 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:16.166059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8f0d821a-7297-4399-8235-491046105383 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:16.171841 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8f0d821a-7297-4399-8235-491046105383 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.172321 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8f0d821a-7297-4399-8235-491046105383 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.173081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8f0d821a-7297-4399-8235-491046105383 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.173512 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8f0d821a-7297-4399-8235-491046105383 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.236044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8f0d821a-7297-4399-8235-491046105383 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:16.243868 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8f0d821a-7297-4399-8235-491046105383 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1300 microversion: 2.1 time: 0.082726 May 10 14:02:16.244465 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 156/294] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:16 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:16.454903 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-05b25d7b-4796-41d4-adb6-239cf35e2b55 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:16.455446 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-05b25d7b-4796-41d4-adb6-239cf35e2b55 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:16.461577 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-05b25d7b-4796-41d4-adb6-239cf35e2b55 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.462035 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-05b25d7b-4796-41d4-adb6-239cf35e2b55 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.463088 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-05b25d7b-4796-41d4-adb6-239cf35e2b55 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.463639 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-05b25d7b-4796-41d4-adb6-239cf35e2b55 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.592492 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-05b25d7b-4796-41d4-adb6-239cf35e2b55 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:16.599779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-05b25d7b-4796-41d4-adb6-239cf35e2b55 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1510 microversion: 2.1 time: 0.148812 May 10 14:02:16.600374 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 139/295] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:16 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:16.696095 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a2d60171-e27b-4f79-9fbc-fd7716750853 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:16.696755 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a2d60171-e27b-4f79-9fbc-fd7716750853 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:16.703204 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a2d60171-e27b-4f79-9fbc-fd7716750853 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.703660 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a2d60171-e27b-4f79-9fbc-fd7716750853 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.704471 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a2d60171-e27b-4f79-9fbc-fd7716750853 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.704967 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a2d60171-e27b-4f79-9fbc-fd7716750853 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.832388 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a2d60171-e27b-4f79-9fbc-fd7716750853 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:16.839526 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a2d60171-e27b-4f79-9fbc-fd7716750853 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1277 microversion: 2.1 time: 0.147981 May 10 14:02:16.840094 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 157/296] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:16 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:16.976675 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1b1ee471-015d-49c6-91d2-6d0ef1f04d87 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:16.977214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1b1ee471-015d-49c6-91d2-6d0ef1f04d87 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:16.983131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1b1ee471-015d-49c6-91d2-6d0ef1f04d87 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.983581 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1b1ee471-015d-49c6-91d2-6d0ef1f04d87 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.984383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1b1ee471-015d-49c6-91d2-6d0ef1f04d87 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.984825 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1b1ee471-015d-49c6-91d2-6d0ef1f04d87 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.118951 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1b1ee471-015d-49c6-91d2-6d0ef1f04d87 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:17.126859 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1b1ee471-015d-49c6-91d2-6d0ef1f04d87 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:17.128419 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1b1ee471-015d-49c6-91d2-6d0ef1f04d87 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:17.129577 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1b1ee471-015d-49c6-91d2-6d0ef1f04d87 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.157454 May 10 14:02:17.130312 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 140/297] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:16 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:17.135166 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0bc3dd49-b6ae-4c94-9e29-1c3e2b3ea625 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:17.135770 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0bc3dd49-b6ae-4c94-9e29-1c3e2b3ea625 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:17.141531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0bc3dd49-b6ae-4c94-9e29-1c3e2b3ea625 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.141974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0bc3dd49-b6ae-4c94-9e29-1c3e2b3ea625 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.142741 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0bc3dd49-b6ae-4c94-9e29-1c3e2b3ea625 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.143170 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0bc3dd49-b6ae-4c94-9e29-1c3e2b3ea625 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.173299 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f1bc3881-7f27-4c75-8c76-ff345fd19dae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:17.173915 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f1bc3881-7f27-4c75-8c76-ff345fd19dae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:17.180484 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f1bc3881-7f27-4c75-8c76-ff345fd19dae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.181010 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f1bc3881-7f27-4c75-8c76-ff345fd19dae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.181791 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f1bc3881-7f27-4c75-8c76-ff345fd19dae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.182231 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f1bc3881-7f27-4c75-8c76-ff345fd19dae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.240909 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f1bc3881-7f27-4c75-8c76-ff345fd19dae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:17.248592 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f1bc3881-7f27-4c75-8c76-ff345fd19dae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1262 microversion: 2.1 time: 0.079006 May 10 14:02:17.249170 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 141/298] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:17 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:17.260997 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6cb964cc-4cf8-48af-b310-0a1edcca50fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:17.261608 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-6cb964cc-4cf8-48af-b310-0a1edcca50fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:17.267521 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6cb964cc-4cf8-48af-b310-0a1edcca50fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.267977 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6cb964cc-4cf8-48af-b310-0a1edcca50fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.268799 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6cb964cc-4cf8-48af-b310-0a1edcca50fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.269244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6cb964cc-4cf8-48af-b310-0a1edcca50fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.270790 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0bc3dd49-b6ae-4c94-9e29-1c3e2b3ea625 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:17.278349 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0bc3dd49-b6ae-4c94-9e29-1c3e2b3ea625 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1470 microversion: 2.1 time: 0.146995 May 10 14:02:17.278921 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 158/299] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:17 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:17.329339 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6cb964cc-4cf8-48af-b310-0a1edcca50fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:17.336430 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6cb964cc-4cf8-48af-b310-0a1edcca50fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1300 microversion: 2.1 time: 0.079607 May 10 14:02:17.337003 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 142/300] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:17 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1300 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:17.617432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2455f09d-900a-4793-802c-fbf39bdf1405 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:17.618060 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2455f09d-900a-4793-802c-fbf39bdf1405 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:17.623992 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2455f09d-900a-4793-802c-fbf39bdf1405 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.624471 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2455f09d-900a-4793-802c-fbf39bdf1405 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.625237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2455f09d-900a-4793-802c-fbf39bdf1405 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.625676 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2455f09d-900a-4793-802c-fbf39bdf1405 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.760553 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2455f09d-900a-4793-802c-fbf39bdf1405 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:17.767743 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2455f09d-900a-4793-802c-fbf39bdf1405 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1516 microversion: 2.1 time: 0.154787 May 10 14:02:17.768517 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 159/301] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:17 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:17.856491 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2ba30056-2f40-42d0-b64c-38e2a52a7e6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:17.857098 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2ba30056-2f40-42d0-b64c-38e2a52a7e6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:17.863248 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2ba30056-2f40-42d0-b64c-38e2a52a7e6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.863702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2ba30056-2f40-42d0-b64c-38e2a52a7e6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.864496 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2ba30056-2f40-42d0-b64c-38e2a52a7e6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.864943 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2ba30056-2f40-42d0-b64c-38e2a52a7e6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.016594 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2ba30056-2f40-42d0-b64c-38e2a52a7e6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:18.025620 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2ba30056-2f40-42d0-b64c-38e2a52a7e6d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1277 microversion: 2.1 time: 0.172813 May 10 14:02:18.026220 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 143/302] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:17 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:18.147141 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-41086452-5506-4a46-a3d5-e8715ae56f8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:18.147686 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-41086452-5506-4a46-a3d5-e8715ae56f8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:18.153995 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41086452-5506-4a46-a3d5-e8715ae56f8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.154442 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41086452-5506-4a46-a3d5-e8715ae56f8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.155203 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41086452-5506-4a46-a3d5-e8715ae56f8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.155643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41086452-5506-4a46-a3d5-e8715ae56f8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.266208 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c3bc06a9-df7f-4d1f-98d9-b295587b5826 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:18.266912 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c3bc06a9-df7f-4d1f-98d9-b295587b5826 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:18.275762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c3bc06a9-df7f-4d1f-98d9-b295587b5826 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.276344 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c3bc06a9-df7f-4d1f-98d9-b295587b5826 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.277200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c3bc06a9-df7f-4d1f-98d9-b295587b5826 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.277690 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c3bc06a9-df7f-4d1f-98d9-b295587b5826 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.301185 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-41086452-5506-4a46-a3d5-e8715ae56f8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:18.310235 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-41086452-5506-4a46-a3d5-e8715ae56f8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:18.311901 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-41086452-5506-4a46-a3d5-e8715ae56f8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:18.313077 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-41086452-5506-4a46-a3d5-e8715ae56f8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.170229 May 10 14:02:18.313643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 160/303] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:18 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:18.318737 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-4f515a2a-743a-40a6-901c-a8783ed56fda tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:18.318737 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-4f515a2a-743a-40a6-901c-a8783ed56fda tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:18.325504 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4f515a2a-743a-40a6-901c-a8783ed56fda tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.326256 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4f515a2a-743a-40a6-901c-a8783ed56fda tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.326737 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4f515a2a-743a-40a6-901c-a8783ed56fda tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.327178 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4f515a2a-743a-40a6-901c-a8783ed56fda tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.364664 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c3bc06a9-df7f-4d1f-98d9-b295587b5826 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:18.372555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c3bc06a9-df7f-4d1f-98d9-b295587b5826 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1262 microversion: 2.1 time: 0.111011 May 10 14:02:18.373264 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 144/304] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:18 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1262 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:18.381932 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-21a8e126-2857-4e6f-a748-d382b974801a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:18.381932 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-21a8e126-2857-4e6f-a748-d382b974801a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:18.406246 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-21a8e126-2857-4e6f-a748-d382b974801a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.406695 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-21a8e126-2857-4e6f-a748-d382b974801a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.407477 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-21a8e126-2857-4e6f-a748-d382b974801a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.407936 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-21a8e126-2857-4e6f-a748-d382b974801a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.485181 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-4f515a2a-743a-40a6-901c-a8783ed56fda tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:18.492868 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-4f515a2a-743a-40a6-901c-a8783ed56fda tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1470 microversion: 2.1 time: 0.178214 May 10 14:02:18.493458 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 161/305] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:18 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:18.509007 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-21a8e126-2857-4e6f-a748-d382b974801a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:18.517257 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-21a8e126-2857-4e6f-a748-d382b974801a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1300 microversion: 2.1 time: 0.142890 May 10 14:02:18.517875 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 145/306] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:18 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1300 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:19.042361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-71575c6e-a402-417d-a8e1-118b0a4a54e4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:19.043026 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-71575c6e-a402-417d-a8e1-118b0a4a54e4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:19.049302 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-71575c6e-a402-417d-a8e1-118b0a4a54e4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.049753 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-71575c6e-a402-417d-a8e1-118b0a4a54e4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.050556 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-71575c6e-a402-417d-a8e1-118b0a4a54e4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.050992 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-71575c6e-a402-417d-a8e1-118b0a4a54e4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.137540 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b3cc0ca5-b9e6-41d8-9db9-3963d5bd9d1a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Action: 'create', calling method: .version_select at 0x7f5f7c37b940>, body: {"keypair": {"name": "tempest-keypair-821191081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItqXvl5MeOO2C70ekpP3T+kxPnH42taW9A8aPMrggwbEN+Nev/hU+yz1sHeVjrj1kIkqXp/nzyuBdfajsLyYZtr+ahJYukNrtkdCul3ZHIP1bwV2ZoaXHQ7IZsPgYkT6Q=="}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:19.155045 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-b3cc0ca5-b9e6-41d8-9db9-3963d5bd9d1a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Getting quotas for project 368287ad726146f88559c73a86e4b26d. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:02:19.160583 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-b3cc0ca5-b9e6-41d8-9db9-3963d5bd9d1a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Getting quotas for user bd14de0fd51c4fd89d9875b9c47100cc and project 368287ad726146f88559c73a86e4b26d. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:02:19.206987 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b3cc0ca5-b9e6-41d8-9db9-3963d5bd9d1a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071719 May 10 14:02:19.207658 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 146/307] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 14:02:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:19.258010 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-71575c6e-a402-417d-a8e1-118b0a4a54e4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:19.271102 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-71575c6e-a402-417d-a8e1-118b0a4a54e4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1277 microversion: 2.1 time: 0.233162 May 10 14:02:19.272267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 162/308] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:19 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:19.334399 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8f48d60b-2b80-4603-bf6f-334cea65adc5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:19.337769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8f48d60b-2b80-4603-bf6f-334cea65adc5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:19.348672 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8f48d60b-2b80-4603-bf6f-334cea65adc5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.349454 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8f48d60b-2b80-4603-bf6f-334cea65adc5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.350411 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8f48d60b-2b80-4603-bf6f-334cea65adc5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.351861 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8f48d60b-2b80-4603-bf6f-334cea65adc5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.390186 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a009e7d2-4b27-4350-acd5-a7fa98b76a09 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:19.390794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a009e7d2-4b27-4350-acd5-a7fa98b76a09 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:19.399914 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a009e7d2-4b27-4350-acd5-a7fa98b76a09 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.401117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a009e7d2-4b27-4350-acd5-a7fa98b76a09 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.402023 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a009e7d2-4b27-4350-acd5-a7fa98b76a09 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.402569 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a009e7d2-4b27-4350-acd5-a7fa98b76a09 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.487390 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a009e7d2-4b27-4350-acd5-a7fa98b76a09 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:19.495971 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a009e7d2-4b27-4350-acd5-a7fa98b76a09 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1310 microversion: 2.1 time: 0.109630 May 10 14:02:19.496815 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 163/309] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:19 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1310 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:19.511267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-fd004297-df52-43ab-8476-82e3e139bbc6 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:19.512307 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-fd004297-df52-43ab-8476-82e3e139bbc6 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:19.519535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fd004297-df52-43ab-8476-82e3e139bbc6 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.519994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fd004297-df52-43ab-8476-82e3e139bbc6 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.520829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fd004297-df52-43ab-8476-82e3e139bbc6 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.521268 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fd004297-df52-43ab-8476-82e3e139bbc6 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.680326 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-fd004297-df52-43ab-8476-82e3e139bbc6 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:19.689245 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-fd004297-df52-43ab-8476-82e3e139bbc6 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1470 microversion: 2.1 time: 0.183216 May 10 14:02:19.690210 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 164/310] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:19 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1470 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:19.696481 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1d005cea-cb93-412a-8f4e-65dc0d88cf1c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:19.697096 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1d005cea-cb93-412a-8f4e-65dc0d88cf1c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:19.704366 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d005cea-cb93-412a-8f4e-65dc0d88cf1c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.704870 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d005cea-cb93-412a-8f4e-65dc0d88cf1c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.705748 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d005cea-cb93-412a-8f4e-65dc0d88cf1c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.706361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d005cea-cb93-412a-8f4e-65dc0d88cf1c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.773328 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8f48d60b-2b80-4603-bf6f-334cea65adc5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:19.783402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8f48d60b-2b80-4603-bf6f-334cea65adc5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:19.785470 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8f48d60b-2b80-4603-bf6f-334cea65adc5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:19.787855 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8f48d60b-2b80-4603-bf6f-334cea65adc5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1743 microversion: 2.20 time: 0.460273 May 10 14:02:19.789541 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 147/311] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:19 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1743 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:19.963380 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1d005cea-cb93-412a-8f4e-65dc0d88cf1c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:19.974208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1d005cea-cb93-412a-8f4e-65dc0d88cf1c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.282713 May 10 14:02:19.975212 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 165/312] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:19 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:20.024602 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-43b4ffbd-9f50-4672-bf71-3e63e6084c01 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:20.031689 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-43b4ffbd-9f50-4672-bf71-3e63e6084c01 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.032413 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-43b4ffbd-9f50-4672-bf71-3e63e6084c01 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.117297 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-43b4ffbd-9f50-4672-bf71-3e63e6084c01 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Going to try to stop instance {{(pid=117153) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 14:02:20.199703 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-43b4ffbd-9f50-4672-bf71-3e63e6084c01 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "POST /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/action" status: 202 len: 0 microversion: 2.1 time: 0.179315 May 10 14:02:20.202646 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 148/313] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:02:20 2022] POST /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:02:20.221821 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3d48d929-acd1-43eb-b9d6-fc1b78473373 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:20.228083 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3d48d929-acd1-43eb-b9d6-fc1b78473373 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:20.247704 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d48d929-acd1-43eb-b9d6-fc1b78473373 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.250717 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d48d929-acd1-43eb-b9d6-fc1b78473373 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.260153 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d48d929-acd1-43eb-b9d6-fc1b78473373 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.260706 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d48d929-acd1-43eb-b9d6-fc1b78473373 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.290537 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-899edd89-0807-4720-9f77-7b49dd1ec3a0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:20.291985 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-899edd89-0807-4720-9f77-7b49dd1ec3a0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:20.305044 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-899edd89-0807-4720-9f77-7b49dd1ec3a0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.305507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-899edd89-0807-4720-9f77-7b49dd1ec3a0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.313104 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-899edd89-0807-4720-9f77-7b49dd1ec3a0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.313610 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-899edd89-0807-4720-9f77-7b49dd1ec3a0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.662205 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3d48d929-acd1-43eb-b9d6-fc1b78473373 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:20.673317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3d48d929-acd1-43eb-b9d6-fc1b78473373 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.460590 May 10 14:02:20.683261 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 166/314] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:20 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:20.688641 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-64d8aa52-a11b-46a2-93dd-79e65fc5c4f6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:20.689296 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-64d8aa52-a11b-46a2-93dd-79e65fc5c4f6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:20.695958 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-64d8aa52-a11b-46a2-93dd-79e65fc5c4f6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.696437 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-64d8aa52-a11b-46a2-93dd-79e65fc5c4f6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.697223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-64d8aa52-a11b-46a2-93dd-79e65fc5c4f6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.697652 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-64d8aa52-a11b-46a2-93dd-79e65fc5c4f6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.828726 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-899edd89-0807-4720-9f77-7b49dd1ec3a0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:20.840414 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-899edd89-0807-4720-9f77-7b49dd1ec3a0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1277 microversion: 2.1 time: 0.554060 May 10 14:02:20.841256 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 149/315] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:20 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1277 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:20.845191 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-64d8aa52-a11b-46a2-93dd-79e65fc5c4f6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:20.857266 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-64d8aa52-a11b-46a2-93dd-79e65fc5c4f6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1316 microversion: 2.1 time: 0.181241 May 10 14:02:20.858115 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 167/316] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:20 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:20.869888 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-afd98474-551a-414a-8f6e-1de5bba03d2a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:20.870700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-afd98474-551a-414a-8f6e-1de5bba03d2a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:20.873159 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ce752107-0e79-46de-8fdf-7290aa34d516 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:20.874514 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ce752107-0e79-46de-8fdf-7290aa34d516 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:20.881875 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-afd98474-551a-414a-8f6e-1de5bba03d2a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.883293 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-afd98474-551a-414a-8f6e-1de5bba03d2a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.883699 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ce752107-0e79-46de-8fdf-7290aa34d516 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.884275 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ce752107-0e79-46de-8fdf-7290aa34d516 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.884510 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-afd98474-551a-414a-8f6e-1de5bba03d2a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.884959 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-afd98474-551a-414a-8f6e-1de5bba03d2a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.885815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ce752107-0e79-46de-8fdf-7290aa34d516 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.886513 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ce752107-0e79-46de-8fdf-7290aa34d516 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:21.256593 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ce752107-0e79-46de-8fdf-7290aa34d516 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:21.266090 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ce752107-0e79-46de-8fdf-7290aa34d516 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1470 microversion: 2.1 time: 0.423514 May 10 14:02:21.268748 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 150/317] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:20 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1470 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:21.286305 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f9e800fb-064d-47c7-98ee-ba5fc4672092 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:21.289348 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f9e800fb-064d-47c7-98ee-ba5fc4672092 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:21.305773 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9e800fb-064d-47c7-98ee-ba5fc4672092 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:21.306228 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9e800fb-064d-47c7-98ee-ba5fc4672092 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:21.309561 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9e800fb-064d-47c7-98ee-ba5fc4672092 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:21.310023 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9e800fb-064d-47c7-98ee-ba5fc4672092 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:21.455023 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-afd98474-551a-414a-8f6e-1de5bba03d2a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:21.474121 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-afd98474-551a-414a-8f6e-1de5bba03d2a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:21.476975 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-afd98474-551a-414a-8f6e-1de5bba03d2a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:21.478455 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-afd98474-551a-414a-8f6e-1de5bba03d2a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1743 microversion: 2.20 time: 0.617998 May 10 14:02:21.479580 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 168/318] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:20 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1743 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:21.696516 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1d367517-13dd-4667-95d5-4bed02f119b7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:21.697138 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1d367517-13dd-4667-95d5-4bed02f119b7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:21.718714 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d367517-13dd-4667-95d5-4bed02f119b7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:21.722368 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d367517-13dd-4667-95d5-4bed02f119b7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:21.728307 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d367517-13dd-4667-95d5-4bed02f119b7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:21.729795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1d367517-13dd-4667-95d5-4bed02f119b7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.165864 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f9e800fb-064d-47c7-98ee-ba5fc4672092 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:22.178778 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f9e800fb-064d-47c7-98ee-ba5fc4672092 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.906830 May 10 14:02:22.179715 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 151/319] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:21 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:22.202054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8cdfa205-819c-4943-9c6f-5ecedd58bdd2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:22.202945 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8cdfa205-819c-4943-9c6f-5ecedd58bdd2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:22.231680 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8cdfa205-819c-4943-9c6f-5ecedd58bdd2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.232125 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8cdfa205-819c-4943-9c6f-5ecedd58bdd2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.232963 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8cdfa205-819c-4943-9c6f-5ecedd58bdd2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.233428 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8cdfa205-819c-4943-9c6f-5ecedd58bdd2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.647648 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8cdfa205-819c-4943-9c6f-5ecedd58bdd2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:22.657208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1d367517-13dd-4667-95d5-4bed02f119b7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:22.658983 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8cdfa205-819c-4943-9c6f-5ecedd58bdd2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.466740 May 10 14:02:22.665619 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 152/320] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:22 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:22.669573 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1d367517-13dd-4667-95d5-4bed02f119b7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.982463 May 10 14:02:22.670731 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 169/321] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:21 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:22.675497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-30942d69-fc58-4f38-b862-2d33ec189bea tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:22.680645 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-e3c59669-6bcf-427f-9ef3-bf337879e702 req-74d52891-332a-414e-af3c-4afa4aa8086b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f8c575-d141-465e-a1d6-0a588d798efc", "name": "network-vif-deleted", "tag": "9b6ddffa-174d-4fdc-9944-6f473aa96b81"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:22.686656 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-30942d69-fc58-4f38-b862-2d33ec189bea tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:22.699844 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-e3c59669-6bcf-427f-9ef3-bf337879e702 req-74d52891-332a-414e-af3c-4afa4aa8086b service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.700603 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-e3c59669-6bcf-427f-9ef3-bf337879e702 req-74d52891-332a-414e-af3c-4afa4aa8086b service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.707220 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-30942d69-fc58-4f38-b862-2d33ec189bea tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.717367 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-30942d69-fc58-4f38-b862-2d33ec189bea tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.721714 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-30942d69-fc58-4f38-b862-2d33ec189bea tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.723952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-30942d69-fc58-4f38-b862-2d33ec189bea tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.751737 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-e3c59669-6bcf-427f-9ef3-bf337879e702 req-74d52891-332a-414e-af3c-4afa4aa8086b service nova] Creating event network-vif-deleted:9b6ddffa-174d-4fdc-9944-6f473aa96b81 for instance 69f8c575-d141-465e-a1d6-0a588d798efc on hv-cinder-84067 May 10 14:02:22.763065 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-e3c59669-6bcf-427f-9ef3-bf337879e702 req-74d52891-332a-414e-af3c-4afa4aa8086b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090856 May 10 14:02:22.765707 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 170/322] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:22.776414 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0f6e3e90-97cf-4524-a3d3-006dad9b7918 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:22.784722 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0f6e3e90-97cf-4524-a3d3-006dad9b7918 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:22.802104 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f6e3e90-97cf-4524-a3d3-006dad9b7918 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.802966 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f6e3e90-97cf-4524-a3d3-006dad9b7918 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.803965 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f6e3e90-97cf-4524-a3d3-006dad9b7918 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.805443 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f6e3e90-97cf-4524-a3d3-006dad9b7918 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.858628 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f6e3e90-97cf-4524-a3d3-006dad9b7918 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.860695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f6e3e90-97cf-4524-a3d3-006dad9b7918 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.861225 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-0f6e3e90-97cf-4524-a3d3-006dad9b7918 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lazy-loading 'fault' on Instance uuid 69f8c575-d141-465e-a1d6-0a588d798efc {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:02:23.010615 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0f6e3e90-97cf-4524-a3d3-006dad9b7918 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:23.021278 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0f6e3e90-97cf-4524-a3d3-006dad9b7918 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1304 microversion: 2.1 time: 0.253022 May 10 14:02:23.034384 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 171/323] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:22 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1304 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:23.046530 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-fde7e37c-a76b-4b36-a5dc-61af7a587138 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:23.047165 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-fde7e37c-a76b-4b36-a5dc-61af7a587138 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:23.069699 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fde7e37c-a76b-4b36-a5dc-61af7a587138 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.070199 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fde7e37c-a76b-4b36-a5dc-61af7a587138 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.071132 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fde7e37c-a76b-4b36-a5dc-61af7a587138 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.071579 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fde7e37c-a76b-4b36-a5dc-61af7a587138 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.287788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-30942d69-fc58-4f38-b862-2d33ec189bea tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:23.295179 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-30942d69-fc58-4f38-b862-2d33ec189bea tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.624885 May 10 14:02:23.296010 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 153/324] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:22 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:23.300692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e24a9064-97a4-4f0c-8872-afcd0636ac5c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:23.301518 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e24a9064-97a4-4f0c-8872-afcd0636ac5c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:23.307973 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e24a9064-97a4-4f0c-8872-afcd0636ac5c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.308799 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e24a9064-97a4-4f0c-8872-afcd0636ac5c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.309569 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e24a9064-97a4-4f0c-8872-afcd0636ac5c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.310003 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e24a9064-97a4-4f0c-8872-afcd0636ac5c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.317247 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-fde7e37c-a76b-4b36-a5dc-61af7a587138 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:23.329569 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-fde7e37c-a76b-4b36-a5dc-61af7a587138 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:23.331458 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-fde7e37c-a76b-4b36-a5dc-61af7a587138 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:23.333162 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-fde7e37c-a76b-4b36-a5dc-61af7a587138 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.297638 May 10 14:02:23.360400 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 172/325] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:23 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:23.368624 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-bc501c70-e1f5-463a-98bb-b950cf90b2e8 req-169a4386-e0cb-4659-9e96-693c5c0ba502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8821a821-144b-4a72-b16e-07014a8063d0", "tag": "12100075-8151-4b48-9d14-6864846987d2"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:23.398022 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-bc501c70-e1f5-463a-98bb-b950cf90b2e8 req-169a4386-e0cb-4659-9e96-693c5c0ba502 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.398664 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-bc501c70-e1f5-463a-98bb-b950cf90b2e8 req-169a4386-e0cb-4659-9e96-693c5c0ba502 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.411989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-bc501c70-e1f5-463a-98bb-b950cf90b2e8 req-169a4386-e0cb-4659-9e96-693c5c0ba502 service nova] Creating event network-changed:12100075-8151-4b48-9d14-6864846987d2 for instance 8821a821-144b-4a72-b16e-07014a8063d0 on hv-cinder-84067 May 10 14:02:23.417601 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-bc501c70-e1f5-463a-98bb-b950cf90b2e8 req-169a4386-e0cb-4659-9e96-693c5c0ba502 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053241 May 10 14:02:23.418622 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 173/326] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:23.550810 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-bf6e1561-61f5-4560-9f24-c4730eb3cc8e req-2f6ac56f-19e9-4293-a1f7-dd00985a0672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067bd8aa-a9d7-41f4-82a3-54e00fe64f68", "name": "network-vif-plugged", "status": "completed", "tag": "0b32a17e-9e2f-475d-abe1-8b69acb4c76a"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:23.568463 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-bf6e1561-61f5-4560-9f24-c4730eb3cc8e req-2f6ac56f-19e9-4293-a1f7-dd00985a0672 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.569040 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-bf6e1561-61f5-4560-9f24-c4730eb3cc8e req-2f6ac56f-19e9-4293-a1f7-dd00985a0672 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.579913 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e24a9064-97a4-4f0c-8872-afcd0636ac5c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:23.582353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-bf6e1561-61f5-4560-9f24-c4730eb3cc8e req-2f6ac56f-19e9-4293-a1f7-dd00985a0672 service nova] Creating event network-vif-plugged:0b32a17e-9e2f-475d-abe1-8b69acb4c76a for instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 on hv-cinder-84067 May 10 14:02:23.588588 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e24a9064-97a4-4f0c-8872-afcd0636ac5c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.291310 May 10 14:02:23.589549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-bf6e1561-61f5-4560-9f24-c4730eb3cc8e req-2f6ac56f-19e9-4293-a1f7-dd00985a0672 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047763 May 10 14:02:23.590031 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 154/327] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:23 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:23.608880 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 174/328] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:23.695443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-16ebac58-a190-4b7b-a443-0cefa732a2d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:23.696052 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-16ebac58-a190-4b7b-a443-0cefa732a2d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:23.701979 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-b3c8d06e-879a-4a34-9e0e-d5d6e18feb0c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:23.703107 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-b3c8d06e-879a-4a34-9e0e-d5d6e18feb0c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:23.705722 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-16ebac58-a190-4b7b-a443-0cefa732a2d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.706165 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-16ebac58-a190-4b7b-a443-0cefa732a2d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.706942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-16ebac58-a190-4b7b-a443-0cefa732a2d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.707370 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-16ebac58-a190-4b7b-a443-0cefa732a2d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.709337 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b3c8d06e-879a-4a34-9e0e-d5d6e18feb0c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.710067 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b3c8d06e-879a-4a34-9e0e-d5d6e18feb0c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.711418 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b3c8d06e-879a-4a34-9e0e-d5d6e18feb0c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.711861 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b3c8d06e-879a-4a34-9e0e-d5d6e18feb0c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.935662 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-b3c8d06e-879a-4a34-9e0e-d5d6e18feb0c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:23.950170 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-b3c8d06e-879a-4a34-9e0e-d5d6e18feb0c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.256385 May 10 14:02:23.952196 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 175/329] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:23 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:24.023036 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-16ebac58-a190-4b7b-a443-0cefa732a2d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:24.031362 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-16ebac58-a190-4b7b-a443-0cefa732a2d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.340241 May 10 14:02:24.032346 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 155/330] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:23 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:24.054760 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-243b0e20-3847-4889-b8b1-8d3229c34c0a tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:24.054760 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-243b0e20-3847-4889-b8b1-8d3229c34c0a tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:24.058584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-243b0e20-3847-4889-b8b1-8d3229c34c0a tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.059316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-243b0e20-3847-4889-b8b1-8d3229c34c0a tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.060459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-243b0e20-3847-4889-b8b1-8d3229c34c0a tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.061138 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-243b0e20-3847-4889-b8b1-8d3229c34c0a tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.099345 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-243b0e20-3847-4889-b8b1-8d3229c34c0a tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.100134 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-243b0e20-3847-4889-b8b1-8d3229c34c0a tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.100683 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-243b0e20-3847-4889-b8b1-8d3229c34c0a tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lazy-loading 'fault' on Instance uuid 69f8c575-d141-465e-a1d6-0a588d798efc {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:02:24.175527 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1595406662", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74785619-4d29-47a9-9c74-95cf48855a3c"}], "security_groups": [{"name": "tempest-securitygroup--964058252"}], "key_name": "tempest-keypair-821191081", "user_data": "}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:24.302110 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.network.neutron [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] validate_networks() for [('74785619-4d29-47a9-9c74-95cf48855a3c', None, None, None, None, None)] {{(pid=117153) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:02:24.392417 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-243b0e20-3847-4889-b8b1-8d3229c34c0a tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:24.408531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-243b0e20-3847-4889-b8b1-8d3229c34c0a tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1304 microversion: 2.1 time: 0.363838 May 10 14:02:24.409821 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 176/331] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:24 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1304 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:24.415726 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1696d32d-e18b-4c93-9c93-0df0602a7964 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:24.416486 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1696d32d-e18b-4c93-9c93-0df0602a7964 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:24.428477 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1696d32d-e18b-4c93-9c93-0df0602a7964 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.432801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1696d32d-e18b-4c93-9c93-0df0602a7964 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.433577 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1696d32d-e18b-4c93-9c93-0df0602a7964 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.434020 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1696d32d-e18b-4c93-9c93-0df0602a7964 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.606921 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1696d32d-e18b-4c93-9c93-0df0602a7964 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:24.616599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1696d32d-e18b-4c93-9c93-0df0602a7964 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.204854 May 10 14:02:24.628035 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 177/332] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:24 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:24.635698 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bbc0c19f-b821-4ab8-9106-cdb41103f1b7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:24.636434 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-bbc0c19f-b821-4ab8-9106-cdb41103f1b7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:24.644590 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bbc0c19f-b821-4ab8-9106-cdb41103f1b7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.645048 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bbc0c19f-b821-4ab8-9106-cdb41103f1b7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.645831 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bbc0c19f-b821-4ab8-9106-cdb41103f1b7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.646269 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bbc0c19f-b821-4ab8-9106-cdb41103f1b7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.787374 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Flavor limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:02:24.788461 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Image limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:02:24.789319 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Flavor pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:02:24.789728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Image pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:02:24.790136 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:02:24.795375 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-bbc0c19f-b821-4ab8-9106-cdb41103f1b7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:24.799601 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.800346 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.801344 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.801989 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.809083 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-bbc0c19f-b821-4ab8-9106-cdb41103f1b7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:24.810604 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-bbc0c19f-b821-4ab8-9106-cdb41103f1b7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:24.811961 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-bbc0c19f-b821-4ab8-9106-cdb41103f1b7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.182820 May 10 14:02:24.812725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 178/333] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:24 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:24.817293 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0a688d34-32a0-41f7-935a-120901694d87 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:24.818089 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0a688d34-32a0-41f7-935a-120901694d87 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:24.824692 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0a688d34-32a0-41f7-935a-120901694d87 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.825323 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0a688d34-32a0-41f7-935a-120901694d87 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.826290 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0a688d34-32a0-41f7-935a-120901694d87 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.826890 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0a688d34-32a0-41f7-935a-120901694d87 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.831488 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Getting quotas for project 368287ad726146f88559c73a86e4b26d. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:02:24.836727 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Getting quotas for user bd14de0fd51c4fd89d9875b9c47100cc and project 368287ad726146f88559c73a86e4b26d. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:02:24.850587 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Going to run 1 instances... {{(pid=117153) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:02:24.853835 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:02:24.925582 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-86670572-ee61-48b0-8340-3218c0c00bab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.754350 May 10 14:02:24.926966 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 156/334] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:02:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 14:02:24.931878 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-9f2f3b0e-a88a-44bc-bdda-2dd84c85e641 req-ca441e8b-cab1-4ff9-aac2-ed3e898ab772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa06f26-fa96-4753-9ea2-c2abecdb7087", "tag": "156485a6-4fc0-40bc-a3c8-0aa824e3cae2"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:24.940276 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-9f2f3b0e-a88a-44bc-bdda-2dd84c85e641 req-ca441e8b-cab1-4ff9-aac2-ed3e898ab772 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.940998 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-9f2f3b0e-a88a-44bc-bdda-2dd84c85e641 req-ca441e8b-cab1-4ff9-aac2-ed3e898ab772 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.952547 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-9f2f3b0e-a88a-44bc-bdda-2dd84c85e641 req-ca441e8b-cab1-4ff9-aac2-ed3e898ab772 service nova] Creating event network-changed:156485a6-4fc0-40bc-a3c8-0aa824e3cae2 for instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 on hv-cinder-84067 May 10 14:02:24.958521 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-9f2f3b0e-a88a-44bc-bdda-2dd84c85e641 req-ca441e8b-cab1-4ff9-aac2-ed3e898ab772 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030132 May 10 14:02:24.959690 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 157/335] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:24.966658 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ec3160fa-e4da-4a30-a497-3ca46102b453 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:24.967637 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ec3160fa-e4da-4a30-a497-3ca46102b453 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:25.034261 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0a688d34-32a0-41f7-935a-120901694d87 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:25.043227 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0a688d34-32a0-41f7-935a-120901694d87 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.228709 May 10 14:02:25.043227 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 179/336] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:24 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:25.048815 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-346439dd-f06f-4d85-a83d-1828441f4998 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:25.049656 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-346439dd-f06f-4d85-a83d-1828441f4998 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:25.058695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-346439dd-f06f-4d85-a83d-1828441f4998 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.059556 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-346439dd-f06f-4d85-a83d-1828441f4998 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.060554 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-346439dd-f06f-4d85-a83d-1828441f4998 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.061150 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-346439dd-f06f-4d85-a83d-1828441f4998 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.083984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ec3160fa-e4da-4a30-a497-3ca46102b453 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:25.096907 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ec3160fa-e4da-4a30-a497-3ca46102b453 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1245 microversion: 2.1 time: 0.133616 May 10 14:02:25.107155 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 158/337] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:24 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1245 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:25.113350 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-dc8c11d4-bbef-4d07-84ed-ed1812c1a4f0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:25.114130 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-dc8c11d4-bbef-4d07-84ed-ed1812c1a4f0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:25.147673 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dc8c11d4-bbef-4d07-84ed-ed1812c1a4f0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.148896 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dc8c11d4-bbef-4d07-84ed-ed1812c1a4f0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.149764 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dc8c11d4-bbef-4d07-84ed-ed1812c1a4f0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.150205 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dc8c11d4-bbef-4d07-84ed-ed1812c1a4f0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.324905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-346439dd-f06f-4d85-a83d-1828441f4998 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:25.334532 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-346439dd-f06f-4d85-a83d-1828441f4998 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.290296 May 10 14:02:25.337287 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 180/338] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:25 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:25.375738 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-dc8c11d4-bbef-4d07-84ed-ed1812c1a4f0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:25.389163 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-dc8c11d4-bbef-4d07-84ed-ed1812c1a4f0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.279814 May 10 14:02:25.391307 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 159/339] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:25 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:25.426562 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-741f0d25-780d-4348-b513-07635632eeae tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:25.427205 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-741f0d25-780d-4348-b513-07635632eeae tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:25.444004 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-741f0d25-780d-4348-b513-07635632eeae tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.444555 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-741f0d25-780d-4348-b513-07635632eeae tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.445325 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-741f0d25-780d-4348-b513-07635632eeae tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.445765 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-741f0d25-780d-4348-b513-07635632eeae tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.489986 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-741f0d25-780d-4348-b513-07635632eeae tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.490440 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-741f0d25-780d-4348-b513-07635632eeae tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.490896 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-741f0d25-780d-4348-b513-07635632eeae tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lazy-loading 'fault' on Instance uuid 69f8c575-d141-465e-a1d6-0a588d798efc {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:02:25.534960 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-741f0d25-780d-4348-b513-07635632eeae tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:25.547340 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-741f0d25-780d-4348-b513-07635632eeae tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1304 microversion: 2.1 time: 0.124749 May 10 14:02:25.547858 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 181/340] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:25 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:25.635196 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8c9941fe-e4a2-44d5-a69e-e82372d028ca tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:25.635896 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8c9941fe-e4a2-44d5-a69e-e82372d028ca tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:25.643449 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8c9941fe-e4a2-44d5-a69e-e82372d028ca tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.644086 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8c9941fe-e4a2-44d5-a69e-e82372d028ca tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.644922 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8c9941fe-e4a2-44d5-a69e-e82372d028ca tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.645363 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8c9941fe-e4a2-44d5-a69e-e82372d028ca tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.777829 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8c9941fe-e4a2-44d5-a69e-e82372d028ca tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:25.785487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8c9941fe-e4a2-44d5-a69e-e82372d028ca tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.155172 May 10 14:02:25.786944 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 160/341] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:25 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:25.830997 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e66d3b3d-2f5f-4b19-8494-0a940ab51bc7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:25.831580 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e66d3b3d-2f5f-4b19-8494-0a940ab51bc7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:25.837586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e66d3b3d-2f5f-4b19-8494-0a940ab51bc7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.838035 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e66d3b3d-2f5f-4b19-8494-0a940ab51bc7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.838805 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e66d3b3d-2f5f-4b19-8494-0a940ab51bc7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.839239 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e66d3b3d-2f5f-4b19-8494-0a940ab51bc7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.974824 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e66d3b3d-2f5f-4b19-8494-0a940ab51bc7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:25.983987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e66d3b3d-2f5f-4b19-8494-0a940ab51bc7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:25.985663 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e66d3b3d-2f5f-4b19-8494-0a940ab51bc7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:25.986877 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e66d3b3d-2f5f-4b19-8494-0a940ab51bc7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.159888 May 10 14:02:25.987624 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 182/342] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:25 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:02:26.061695 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-59d4b3f4-03fd-4b98-b543-cfbeef5cc957 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:26.062437 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-59d4b3f4-03fd-4b98-b543-cfbeef5cc957 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:26.068502 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-59d4b3f4-03fd-4b98-b543-cfbeef5cc957 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.068953 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-59d4b3f4-03fd-4b98-b543-cfbeef5cc957 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.069761 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-59d4b3f4-03fd-4b98-b543-cfbeef5cc957 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.070319 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-59d4b3f4-03fd-4b98-b543-cfbeef5cc957 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.116278 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a6c40f95-ca27-439e-a01f-4df150f8aa1a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:26.117203 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a6c40f95-ca27-439e-a01f-4df150f8aa1a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:26.123339 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a6c40f95-ca27-439e-a01f-4df150f8aa1a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.123793 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a6c40f95-ca27-439e-a01f-4df150f8aa1a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.124607 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a6c40f95-ca27-439e-a01f-4df150f8aa1a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.125046 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a6c40f95-ca27-439e-a01f-4df150f8aa1a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.197549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a6c40f95-ca27-439e-a01f-4df150f8aa1a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:26.205515 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a6c40f95-ca27-439e-a01f-4df150f8aa1a tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1249 microversion: 2.1 time: 0.093808 May 10 14:02:26.214917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 183/343] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:26 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1249 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:26.232913 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-59d4b3f4-03fd-4b98-b543-cfbeef5cc957 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:26.240228 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-59d4b3f4-03fd-4b98-b543-cfbeef5cc957 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.182634 May 10 14:02:26.240813 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 161/344] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:26 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:26.352640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-64bad873-f2a2-4cbd-a43a-ae8b1e730337 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:26.353371 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-64bad873-f2a2-4cbd-a43a-ae8b1e730337 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:26.359829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-64bad873-f2a2-4cbd-a43a-ae8b1e730337 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.360400 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-64bad873-f2a2-4cbd-a43a-ae8b1e730337 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.361250 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-64bad873-f2a2-4cbd-a43a-ae8b1e730337 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.362748 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-64bad873-f2a2-4cbd-a43a-ae8b1e730337 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.408592 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5de42ef2-f3b1-404a-8ba4-7570d9d78245 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:26.409211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-5de42ef2-f3b1-404a-8ba4-7570d9d78245 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:26.415390 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5de42ef2-f3b1-404a-8ba4-7570d9d78245 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.415836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5de42ef2-f3b1-404a-8ba4-7570d9d78245 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.416645 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5de42ef2-f3b1-404a-8ba4-7570d9d78245 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.417079 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5de42ef2-f3b1-404a-8ba4-7570d9d78245 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.524406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-64bad873-f2a2-4cbd-a43a-ae8b1e730337 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:26.536403 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-64bad873-f2a2-4cbd-a43a-ae8b1e730337 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.184137 May 10 14:02:26.537806 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 184/345] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:26 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:26.565292 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-747c9d70-632c-468a-b2c4-a2b20e148831 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:26.565907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-747c9d70-632c-468a-b2c4-a2b20e148831 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:26.577597 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-747c9d70-632c-468a-b2c4-a2b20e148831 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.579403 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-747c9d70-632c-468a-b2c4-a2b20e148831 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.580649 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-747c9d70-632c-468a-b2c4-a2b20e148831 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.581447 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-747c9d70-632c-468a-b2c4-a2b20e148831 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.607240 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-5de42ef2-f3b1-404a-8ba4-7570d9d78245 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:26.619218 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-5de42ef2-f3b1-404a-8ba4-7570d9d78245 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.214888 May 10 14:02:26.620017 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 162/346] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:26 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:26.620278 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-747c9d70-632c-468a-b2c4-a2b20e148831 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.620728 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-747c9d70-632c-468a-b2c4-a2b20e148831 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.621175 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-747c9d70-632c-468a-b2c4-a2b20e148831 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lazy-loading 'fault' on Instance uuid 69f8c575-d141-465e-a1d6-0a588d798efc {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:02:26.662894 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-747c9d70-632c-468a-b2c4-a2b20e148831 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:26.671732 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-747c9d70-632c-468a-b2c4-a2b20e148831 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1304 microversion: 2.1 time: 0.110553 May 10 14:02:26.672542 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 185/347] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:26 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:26.802762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7a873279-b907-4458-8f59-f342f155f4e1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:26.803370 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7a873279-b907-4458-8f59-f342f155f4e1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:26.810125 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7a873279-b907-4458-8f59-f342f155f4e1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.810576 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7a873279-b907-4458-8f59-f342f155f4e1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.811344 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7a873279-b907-4458-8f59-f342f155f4e1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.811778 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7a873279-b907-4458-8f59-f342f155f4e1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.952540 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7a873279-b907-4458-8f59-f342f155f4e1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:26.962636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7a873279-b907-4458-8f59-f342f155f4e1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.163539 May 10 14:02:26.973412 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 163/348] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:26 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:27.006374 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-370177cc-d8d2-4ad9-8f92-77afdfd05396 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:27.007045 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-370177cc-d8d2-4ad9-8f92-77afdfd05396 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:27.014312 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-370177cc-d8d2-4ad9-8f92-77afdfd05396 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.014768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-370177cc-d8d2-4ad9-8f92-77afdfd05396 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.015708 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-370177cc-d8d2-4ad9-8f92-77afdfd05396 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.016155 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-370177cc-d8d2-4ad9-8f92-77afdfd05396 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.163912 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-370177cc-d8d2-4ad9-8f92-77afdfd05396 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:27.172066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-370177cc-d8d2-4ad9-8f92-77afdfd05396 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:27.173708 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-370177cc-d8d2-4ad9-8f92-77afdfd05396 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:27.174946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-370177cc-d8d2-4ad9-8f92-77afdfd05396 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.173491 May 10 14:02:27.175587 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 186/349] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:27 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:27.222029 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1154b75a-918c-4154-88ab-747d8d188d2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:27.222595 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1154b75a-918c-4154-88ab-747d8d188d2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:27.228733 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1154b75a-918c-4154-88ab-747d8d188d2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.229185 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1154b75a-918c-4154-88ab-747d8d188d2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.229963 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1154b75a-918c-4154-88ab-747d8d188d2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.230405 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1154b75a-918c-4154-88ab-747d8d188d2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.258618 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7bb4f84f-c473-4522-9b70-f2ace3aed852 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:27.259230 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7bb4f84f-c473-4522-9b70-f2ace3aed852 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:27.265764 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7bb4f84f-c473-4522-9b70-f2ace3aed852 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.266227 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7bb4f84f-c473-4522-9b70-f2ace3aed852 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.267018 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7bb4f84f-c473-4522-9b70-f2ace3aed852 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.267459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7bb4f84f-c473-4522-9b70-f2ace3aed852 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.297268 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1154b75a-918c-4154-88ab-747d8d188d2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:27.307289 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1154b75a-918c-4154-88ab-747d8d188d2c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1249 microversion: 2.1 time: 0.089039 May 10 14:02:27.308343 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 164/350] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:27 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:27.416617 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7bb4f84f-c473-4522-9b70-f2ace3aed852 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:27.424866 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7bb4f84f-c473-4522-9b70-f2ace3aed852 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.170552 May 10 14:02:27.425645 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 187/351] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:27 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:27.554733 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f36cd45e-2d1a-407a-966a-1604c04a6e4a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:27.555348 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f36cd45e-2d1a-407a-966a-1604c04a6e4a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:27.561382 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f36cd45e-2d1a-407a-966a-1604c04a6e4a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.561833 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f36cd45e-2d1a-407a-966a-1604c04a6e4a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.562607 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f36cd45e-2d1a-407a-966a-1604c04a6e4a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.563041 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f36cd45e-2d1a-407a-966a-1604c04a6e4a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.636393 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-57a77f26-bb46-41b5-aaf1-ebd6a3a2ab84 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:27.637167 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-57a77f26-bb46-41b5-aaf1-ebd6a3a2ab84 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:27.643805 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-57a77f26-bb46-41b5-aaf1-ebd6a3a2ab84 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.644489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-57a77f26-bb46-41b5-aaf1-ebd6a3a2ab84 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.645381 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-57a77f26-bb46-41b5-aaf1-ebd6a3a2ab84 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.645983 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-57a77f26-bb46-41b5-aaf1-ebd6a3a2ab84 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.703881 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f36cd45e-2d1a-407a-966a-1604c04a6e4a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:27.712426 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f36cd45e-2d1a-407a-966a-1604c04a6e4a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.161503 May 10 14:02:27.713876 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 165/352] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:27 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:27.719472 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5681d809-8c7e-4b08-9bf5-cdbc5aee2f37 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:27.720453 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-5681d809-8c7e-4b08-9bf5-cdbc5aee2f37 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:27.727870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5681d809-8c7e-4b08-9bf5-cdbc5aee2f37 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.728355 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5681d809-8c7e-4b08-9bf5-cdbc5aee2f37 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.729148 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5681d809-8c7e-4b08-9bf5-cdbc5aee2f37 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.729587 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5681d809-8c7e-4b08-9bf5-cdbc5aee2f37 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.773444 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5681d809-8c7e-4b08-9bf5-cdbc5aee2f37 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.773921 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5681d809-8c7e-4b08-9bf5-cdbc5aee2f37 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.774456 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-5681d809-8c7e-4b08-9bf5-cdbc5aee2f37 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lazy-loading 'fault' on Instance uuid 69f8c575-d141-465e-a1d6-0a588d798efc {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:02:27.802186 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-57a77f26-bb46-41b5-aaf1-ebd6a3a2ab84 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:27.811411 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-57a77f26-bb46-41b5-aaf1-ebd6a3a2ab84 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.179277 May 10 14:02:27.821990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 188/353] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:27 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:27.827244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-5681d809-8c7e-4b08-9bf5-cdbc5aee2f37 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:27.842836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-5681d809-8c7e-4b08-9bf5-cdbc5aee2f37 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1304 microversion: 2.1 time: 0.127353 May 10 14:02:27.849874 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 166/354] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:27 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:27.980512 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-da37dc5c-3d14-4fb0-bfa4-69dd0654b0bc tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:27.981132 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-da37dc5c-3d14-4fb0-bfa4-69dd0654b0bc tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:27.987042 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-da37dc5c-3d14-4fb0-bfa4-69dd0654b0bc tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.987494 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-da37dc5c-3d14-4fb0-bfa4-69dd0654b0bc tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.988294 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-da37dc5c-3d14-4fb0-bfa4-69dd0654b0bc tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.988736 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-da37dc5c-3d14-4fb0-bfa4-69dd0654b0bc tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.124316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-da37dc5c-3d14-4fb0-bfa4-69dd0654b0bc tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:28.131795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-da37dc5c-3d14-4fb0-bfa4-69dd0654b0bc tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.155089 May 10 14:02:28.141268 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 189/355] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:27 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:28.195078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0aa9a7aa-8eeb-4095-86f9-71fbc58d6336 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:28.195675 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0aa9a7aa-8eeb-4095-86f9-71fbc58d6336 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:28.201769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0aa9a7aa-8eeb-4095-86f9-71fbc58d6336 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.202220 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0aa9a7aa-8eeb-4095-86f9-71fbc58d6336 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.202997 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0aa9a7aa-8eeb-4095-86f9-71fbc58d6336 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.203425 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0aa9a7aa-8eeb-4095-86f9-71fbc58d6336 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.324553 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f06aa420-6f0f-408a-b52a-02de8eb16d87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:28.325721 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f06aa420-6f0f-408a-b52a-02de8eb16d87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:28.331719 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f06aa420-6f0f-408a-b52a-02de8eb16d87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.332188 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f06aa420-6f0f-408a-b52a-02de8eb16d87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.332967 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f06aa420-6f0f-408a-b52a-02de8eb16d87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.333408 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f06aa420-6f0f-408a-b52a-02de8eb16d87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.365047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0aa9a7aa-8eeb-4095-86f9-71fbc58d6336 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:28.373765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0aa9a7aa-8eeb-4095-86f9-71fbc58d6336 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:28.375263 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0aa9a7aa-8eeb-4095-86f9-71fbc58d6336 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:28.378954 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0aa9a7aa-8eeb-4095-86f9-71fbc58d6336 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.185274 May 10 14:02:28.378954 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 167/356] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:28 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:28.422012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f06aa420-6f0f-408a-b52a-02de8eb16d87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:28.429703 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f06aa420-6f0f-408a-b52a-02de8eb16d87 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1249 microversion: 2.1 time: 0.109346 May 10 14:02:28.440321 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 190/357] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:28 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1249 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:28.442315 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-69f6f5e7-386a-4de7-9613-bcbb2c5ce83d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:28.442953 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-69f6f5e7-386a-4de7-9613-bcbb2c5ce83d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:28.453497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-69f6f5e7-386a-4de7-9613-bcbb2c5ce83d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.454262 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-69f6f5e7-386a-4de7-9613-bcbb2c5ce83d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.455265 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-69f6f5e7-386a-4de7-9613-bcbb2c5ce83d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.455897 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-69f6f5e7-386a-4de7-9613-bcbb2c5ce83d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.594651 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-69f6f5e7-386a-4de7-9613-bcbb2c5ce83d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:28.602274 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-69f6f5e7-386a-4de7-9613-bcbb2c5ce83d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.163784 May 10 14:02:28.602922 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 168/358] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:28 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:28.729596 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9fe1b739-6ae4-45a8-81ec-2fa262e6d02e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:28.730206 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9fe1b739-6ae4-45a8-81ec-2fa262e6d02e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:28.736201 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9fe1b739-6ae4-45a8-81ec-2fa262e6d02e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.736664 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9fe1b739-6ae4-45a8-81ec-2fa262e6d02e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.737432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9fe1b739-6ae4-45a8-81ec-2fa262e6d02e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.737867 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9fe1b739-6ae4-45a8-81ec-2fa262e6d02e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.829096 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-71caafa4-c525-4291-b244-829882746439 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:28.829822 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-71caafa4-c525-4291-b244-829882746439 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:28.836238 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-71caafa4-c525-4291-b244-829882746439 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.836807 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-71caafa4-c525-4291-b244-829882746439 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.837665 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-71caafa4-c525-4291-b244-829882746439 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.838228 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-71caafa4-c525-4291-b244-829882746439 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.901993 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9fe1b739-6ae4-45a8-81ec-2fa262e6d02e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:28.910238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9fe1b739-6ae4-45a8-81ec-2fa262e6d02e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.184500 May 10 14:02:28.920105 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 191/359] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:28 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:28.920105 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-435d6c8c-a577-43b0-bf69-cb3351192dc7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:28.920105 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-435d6c8c-a577-43b0-bf69-cb3351192dc7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:28.926515 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-435d6c8c-a577-43b0-bf69-cb3351192dc7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.927102 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-435d6c8c-a577-43b0-bf69-cb3351192dc7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.928015 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-435d6c8c-a577-43b0-bf69-cb3351192dc7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.928685 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-435d6c8c-a577-43b0-bf69-cb3351192dc7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.961873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-435d6c8c-a577-43b0-bf69-cb3351192dc7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.962358 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-435d6c8c-a577-43b0-bf69-cb3351192dc7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.962817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-435d6c8c-a577-43b0-bf69-cb3351192dc7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lazy-loading 'fault' on Instance uuid 69f8c575-d141-465e-a1d6-0a588d798efc {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:02:29.013250 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-435d6c8c-a577-43b0-bf69-cb3351192dc7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:29.017864 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-71caafa4-c525-4291-b244-829882746439 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:29.023596 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-435d6c8c-a577-43b0-bf69-cb3351192dc7 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1304 microversion: 2.1 time: 0.111247 May 10 14:02:29.028105 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 192/360] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:28 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:29.028232 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-71caafa4-c525-4291-b244-829882746439 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.201434 May 10 14:02:29.028232 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 169/361] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:28 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:29.151166 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2dfa7354-29d8-4716-b887-bac7b18d8b78 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:29.152057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2dfa7354-29d8-4716-b887-bac7b18d8b78 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:29.161398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2dfa7354-29d8-4716-b887-bac7b18d8b78 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.162033 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2dfa7354-29d8-4716-b887-bac7b18d8b78 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.162986 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2dfa7354-29d8-4716-b887-bac7b18d8b78 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.164193 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2dfa7354-29d8-4716-b887-bac7b18d8b78 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.296152 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2dfa7354-29d8-4716-b887-bac7b18d8b78 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:29.304813 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2dfa7354-29d8-4716-b887-bac7b18d8b78 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.159710 May 10 14:02:29.305597 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 193/362] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:29 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:29.396290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-52b28f92-37c5-47d9-bbe4-e37cc2bb424d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:29.397153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-52b28f92-37c5-47d9-bbe4-e37cc2bb424d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:29.403408 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-52b28f92-37c5-47d9-bbe4-e37cc2bb424d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.403784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-52b28f92-37c5-47d9-bbe4-e37cc2bb424d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.404594 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-52b28f92-37c5-47d9-bbe4-e37cc2bb424d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.405015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-52b28f92-37c5-47d9-bbe4-e37cc2bb424d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.447435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a220b484-a34f-4cc4-8219-4eea586aaa7c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:29.448063 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a220b484-a34f-4cc4-8219-4eea586aaa7c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:29.454555 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a220b484-a34f-4cc4-8219-4eea586aaa7c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.455006 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a220b484-a34f-4cc4-8219-4eea586aaa7c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.455786 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a220b484-a34f-4cc4-8219-4eea586aaa7c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.456259 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a220b484-a34f-4cc4-8219-4eea586aaa7c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.525383 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a220b484-a34f-4cc4-8219-4eea586aaa7c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:29.532928 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a220b484-a34f-4cc4-8219-4eea586aaa7c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1249 microversion: 2.1 time: 0.089826 May 10 14:02:29.533881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 194/363] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:29 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:29.557385 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-52b28f92-37c5-47d9-bbe4-e37cc2bb424d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:29.565426 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-52b28f92-37c5-47d9-bbe4-e37cc2bb424d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:29.578806 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-52b28f92-37c5-47d9-bbe4-e37cc2bb424d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:29.578806 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-52b28f92-37c5-47d9-bbe4-e37cc2bb424d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.175733 May 10 14:02:29.578806 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 170/364] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:29 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:29.621190 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cc670742-563b-456c-8bd9-c663ceed3ae5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:29.621861 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-cc670742-563b-456c-8bd9-c663ceed3ae5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:29.628707 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cc670742-563b-456c-8bd9-c663ceed3ae5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.629155 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cc670742-563b-456c-8bd9-c663ceed3ae5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.629936 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cc670742-563b-456c-8bd9-c663ceed3ae5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.630401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cc670742-563b-456c-8bd9-c663ceed3ae5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.772770 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-cc670742-563b-456c-8bd9-c663ceed3ae5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:29.779950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cc670742-563b-456c-8bd9-c663ceed3ae5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.163859 May 10 14:02:29.780590 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 195/365] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:29 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:29.926850 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c4974419-a6de-4f69-9b83-3efe13e0a2de tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:29.927471 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c4974419-a6de-4f69-9b83-3efe13e0a2de tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:29.933743 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c4974419-a6de-4f69-9b83-3efe13e0a2de tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.934197 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c4974419-a6de-4f69-9b83-3efe13e0a2de tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.934975 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c4974419-a6de-4f69-9b83-3efe13e0a2de tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.935426 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c4974419-a6de-4f69-9b83-3efe13e0a2de tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.040663 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-347a0265-3471-43e0-aae7-531fe7325b05 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:30.041313 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-347a0265-3471-43e0-aae7-531fe7325b05 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:30.048056 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-347a0265-3471-43e0-aae7-531fe7325b05 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.048608 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-347a0265-3471-43e0-aae7-531fe7325b05 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.049389 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-347a0265-3471-43e0-aae7-531fe7325b05 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.049827 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-347a0265-3471-43e0-aae7-531fe7325b05 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.081847 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-347a0265-3471-43e0-aae7-531fe7325b05 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.082351 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-347a0265-3471-43e0-aae7-531fe7325b05 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.082803 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-347a0265-3471-43e0-aae7-531fe7325b05 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lazy-loading 'fault' on Instance uuid 69f8c575-d141-465e-a1d6-0a588d798efc {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:02:30.099476 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c4974419-a6de-4f69-9b83-3efe13e0a2de tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:30.116110 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c4974419-a6de-4f69-9b83-3efe13e0a2de tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.192936 May 10 14:02:30.117561 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 171/366] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:29 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:30.122091 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-41bf8f65-de6b-41eb-97e7-53d62acb65e7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:30.122723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-41bf8f65-de6b-41eb-97e7-53d62acb65e7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:30.128664 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-41bf8f65-de6b-41eb-97e7-53d62acb65e7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.129118 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-41bf8f65-de6b-41eb-97e7-53d62acb65e7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.129896 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-41bf8f65-de6b-41eb-97e7-53d62acb65e7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.130333 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-41bf8f65-de6b-41eb-97e7-53d62acb65e7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.136909 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-347a0265-3471-43e0-aae7-531fe7325b05 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:30.144506 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-347a0265-3471-43e0-aae7-531fe7325b05 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1304 microversion: 2.1 time: 0.107993 May 10 14:02:30.152598 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 196/367] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:30 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:30.271347 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-41bf8f65-de6b-41eb-97e7-53d62acb65e7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:30.279373 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-41bf8f65-de6b-41eb-97e7-53d62acb65e7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.160979 May 10 14:02:30.279943 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 172/368] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:30 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:30.321518 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-de9cad32-e7fe-4a52-aaf4-ecc16c6f5ae8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:30.322200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-de9cad32-e7fe-4a52-aaf4-ecc16c6f5ae8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:30.328416 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-de9cad32-e7fe-4a52-aaf4-ecc16c6f5ae8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.328946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-de9cad32-e7fe-4a52-aaf4-ecc16c6f5ae8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.329795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-de9cad32-e7fe-4a52-aaf4-ecc16c6f5ae8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.330316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-de9cad32-e7fe-4a52-aaf4-ecc16c6f5ae8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.465376 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-de9cad32-e7fe-4a52-aaf4-ecc16c6f5ae8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:30.472775 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-de9cad32-e7fe-4a52-aaf4-ecc16c6f5ae8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.155239 May 10 14:02:30.473351 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 197/369] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:30 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:30.550550 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fae11876-6e80-4f86-b81f-96bb10fb9031 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:30.551236 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fae11876-6e80-4f86-b81f-96bb10fb9031 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:30.557343 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fae11876-6e80-4f86-b81f-96bb10fb9031 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.557796 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fae11876-6e80-4f86-b81f-96bb10fb9031 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.558570 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fae11876-6e80-4f86-b81f-96bb10fb9031 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.559007 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fae11876-6e80-4f86-b81f-96bb10fb9031 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.596566 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a141f91c-92d3-4e2b-b74b-c1c1e92caf71 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:30.597086 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a141f91c-92d3-4e2b-b74b-c1c1e92caf71 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:30.603046 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a141f91c-92d3-4e2b-b74b-c1c1e92caf71 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.603496 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a141f91c-92d3-4e2b-b74b-c1c1e92caf71 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.604290 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a141f91c-92d3-4e2b-b74b-c1c1e92caf71 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.604727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a141f91c-92d3-4e2b-b74b-c1c1e92caf71 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.620669 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-fae11876-6e80-4f86-b81f-96bb10fb9031 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:30.627750 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fae11876-6e80-4f86-b81f-96bb10fb9031 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1249 microversion: 2.1 time: 0.081324 May 10 14:02:30.628353 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 173/370] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:30 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:30.745432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a141f91c-92d3-4e2b-b74b-c1c1e92caf71 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:30.753110 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a141f91c-92d3-4e2b-b74b-c1c1e92caf71 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:30.754598 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a141f91c-92d3-4e2b-b74b-c1c1e92caf71 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:30.755745 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a141f91c-92d3-4e2b-b74b-c1c1e92caf71 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.163085 May 10 14:02:30.756326 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 198/371] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:30 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:02:30.797109 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-192f1c63-5868-4858-b5b8-505543dc8bb8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:30.797717 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-192f1c63-5868-4858-b5b8-505543dc8bb8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:30.803506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-192f1c63-5868-4858-b5b8-505543dc8bb8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.804469 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-192f1c63-5868-4858-b5b8-505543dc8bb8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.805233 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-192f1c63-5868-4858-b5b8-505543dc8bb8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.805667 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-192f1c63-5868-4858-b5b8-505543dc8bb8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.934185 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-192f1c63-5868-4858-b5b8-505543dc8bb8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:30.941476 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-192f1c63-5868-4858-b5b8-505543dc8bb8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.148226 May 10 14:02:30.942047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 174/372] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:30 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:31.133323 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a3ff565b-b1d2-4601-b70c-6590eeb8f48b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:31.133866 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a3ff565b-b1d2-4601-b70c-6590eeb8f48b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:31.139563 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a3ff565b-b1d2-4601-b70c-6590eeb8f48b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.140006 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a3ff565b-b1d2-4601-b70c-6590eeb8f48b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.140809 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a3ff565b-b1d2-4601-b70c-6590eeb8f48b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.141243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a3ff565b-b1d2-4601-b70c-6590eeb8f48b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.161421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e2ac34ab-539a-4ddb-91a3-a3fa499b4ef5 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:31.162202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e2ac34ab-539a-4ddb-91a3-a3fa499b4ef5 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:31.169575 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2ac34ab-539a-4ddb-91a3-a3fa499b4ef5 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.170769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2ac34ab-539a-4ddb-91a3-a3fa499b4ef5 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.171635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2ac34ab-539a-4ddb-91a3-a3fa499b4ef5 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.172095 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2ac34ab-539a-4ddb-91a3-a3fa499b4ef5 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.204078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2ac34ab-539a-4ddb-91a3-a3fa499b4ef5 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.204562 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2ac34ab-539a-4ddb-91a3-a3fa499b4ef5 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.205015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-e2ac34ab-539a-4ddb-91a3-a3fa499b4ef5 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lazy-loading 'fault' on Instance uuid 69f8c575-d141-465e-a1d6-0a588d798efc {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:02:31.245799 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e2ac34ab-539a-4ddb-91a3-a3fa499b4ef5 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d7e361f048469aa63bcb2fac42ed83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4505b52714863b9bf8143c27f0a02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:31.253123 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e2ac34ab-539a-4ddb-91a3-a3fa499b4ef5 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 200 len: 1304 microversion: 2.1 time: 0.095514 May 10 14:02:31.253700 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 175/373] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:31 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:31.271982 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a3ff565b-b1d2-4601-b70c-6590eeb8f48b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:31.279807 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a3ff565b-b1d2-4601-b70c-6590eeb8f48b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.150295 May 10 14:02:31.280409 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 199/374] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:31 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:31.296510 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ba650cc1-c721-494d-90f7-4325e6ca6aa4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:31.297126 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ba650cc1-c721-494d-90f7-4325e6ca6aa4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:31.304331 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ba650cc1-c721-494d-90f7-4325e6ca6aa4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.304894 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ba650cc1-c721-494d-90f7-4325e6ca6aa4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.305785 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ba650cc1-c721-494d-90f7-4325e6ca6aa4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.306452 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ba650cc1-c721-494d-90f7-4325e6ca6aa4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.490207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cc80c765-2235-45db-84c6-b978bb2765bd tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:31.491872 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-cc80c765-2235-45db-84c6-b978bb2765bd tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:31.504690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cc80c765-2235-45db-84c6-b978bb2765bd tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.506813 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cc80c765-2235-45db-84c6-b978bb2765bd tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.510029 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cc80c765-2235-45db-84c6-b978bb2765bd tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.511255 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cc80c765-2235-45db-84c6-b978bb2765bd tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.536716 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ba650cc1-c721-494d-90f7-4325e6ca6aa4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:31.545436 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ba650cc1-c721-494d-90f7-4325e6ca6aa4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.252818 May 10 14:02:31.558402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 176/375] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:31 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:31.644776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-cb8fec41-843f-4452-90d3-374ab6c02446 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:31.645612 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-cb8fec41-843f-4452-90d3-374ab6c02446 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:31.652809 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cb8fec41-843f-4452-90d3-374ab6c02446 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.653262 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cb8fec41-843f-4452-90d3-374ab6c02446 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.654432 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cb8fec41-843f-4452-90d3-374ab6c02446 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.655288 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cb8fec41-843f-4452-90d3-374ab6c02446 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.753765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-cb8fec41-843f-4452-90d3-374ab6c02446 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:31.762148 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-cb8fec41-843f-4452-90d3-374ab6c02446 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1297 microversion: 2.1 time: 0.121536 May 10 14:02:31.762811 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 177/376] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:31 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1297 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:31.777062 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a848a883-f841-4cea-8acd-d417294f2804 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:31.777674 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a848a883-f841-4cea-8acd-d417294f2804 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:31.784032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a848a883-f841-4cea-8acd-d417294f2804 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.784562 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a848a883-f841-4cea-8acd-d417294f2804 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.785720 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a848a883-f841-4cea-8acd-d417294f2804 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.786169 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a848a883-f841-4cea-8acd-d417294f2804 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.798820 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-cc80c765-2235-45db-84c6-b978bb2765bd tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:31.807333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cc80c765-2235-45db-84c6-b978bb2765bd tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.321911 May 10 14:02:31.808054 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 200/377] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:31 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:31.924015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a848a883-f841-4cea-8acd-d417294f2804 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:31.931732 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a848a883-f841-4cea-8acd-d417294f2804 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:31.933266 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a848a883-f841-4cea-8acd-d417294f2804 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:31.934400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a848a883-f841-4cea-8acd-d417294f2804 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.161237 May 10 14:02:31.934957 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 178/378] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:31 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:31.958461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0e131797-1b6f-4eb0-a329-e72f8a664331 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:31.959069 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0e131797-1b6f-4eb0-a329-e72f8a664331 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:31.966225 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e131797-1b6f-4eb0-a329-e72f8a664331 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.967104 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e131797-1b6f-4eb0-a329-e72f8a664331 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.968141 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e131797-1b6f-4eb0-a329-e72f8a664331 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.968606 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e131797-1b6f-4eb0-a329-e72f8a664331 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.118087 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0e131797-1b6f-4eb0-a329-e72f8a664331 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:32.128779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0e131797-1b6f-4eb0-a329-e72f8a664331 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.173591 May 10 14:02:32.129674 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 201/379] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:31 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:32.282694 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-190d6e03-da5b-4dbe-9d8f-4aeb8739f796 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:32.284315 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-190d6e03-da5b-4dbe-9d8f-4aeb8739f796 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] [instance: 69f8c575-d141-465e-a1d6-0a588d798efc] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:32.298633 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-190d6e03-da5b-4dbe-9d8f-4aeb8739f796 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.299081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-190d6e03-da5b-4dbe-9d8f-4aeb8739f796 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.299384 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a1d835c3-1df7-4a24-b903-411c80e9ce20 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:32.299900 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-190d6e03-da5b-4dbe-9d8f-4aeb8739f796 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.300216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a1d835c3-1df7-4a24-b903-411c80e9ce20 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:32.300366 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-190d6e03-da5b-4dbe-9d8f-4aeb8739f796 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.315201 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a1d835c3-1df7-4a24-b903-411c80e9ce20 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.316937 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a1d835c3-1df7-4a24-b903-411c80e9ce20 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.318434 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a1d835c3-1df7-4a24-b903-411c80e9ce20 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.318745 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-190d6e03-da5b-4dbe-9d8f-4aeb8739f796 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] HTTP exception thrown: Instance 69f8c575-d141-465e-a1d6-0a588d798efc could not be found. May 10 14:02:32.319978 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a1d835c3-1df7-4a24-b903-411c80e9ce20 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-190d6e03-da5b-4dbe-9d8f-4aeb8739f796 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Request method failure captured: May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc HTTP/1.1 May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABienBOdgXon_qDiWH8ycccnbmecXnrAGmtoI5fk_nup67xcAvUQ0xi9zsVykopBr28Gh0dyVNoaIAvstaYdPhJKumPBtynJ3AYUfzYaM70AYsFFxNsmKajKZq54jFjXFDR3VrtVFS1cw5_8L_0FpbSGaWPpB4SsA0QprJfC1NNyh1KTIo May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: cdc4505b52714863b9bf8143c27f0a02 May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-VolumesNegativeTest-570253048 May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:02:32.321032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:02:32.322522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdc4505b52714863b9bf8143c27f0a02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdc4505b52714863b9bf8143c27f0a02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdc4505b52714863b9bf8143c27f0a02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdc4505b52714863b9bf8143c27f0a02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:02:32.322522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-VolumesNegativeTest-570253048 May 10 14:02:32.322522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: cdc4505b52714863b9bf8143c27f0a02 May 10 14:02:32.322522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-VolumesNegativeTest-570253048 May 10 14:02:32.322522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-VolumesNegativeTest-570253048-project May 10 14:02:32.322522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:02:32.322522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:02:32.322522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: c4d7e361f048469aa63bcb2fac42ed83 May 10 14:02:32.322522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-VolumesNegativeTest-570253048-project May 10 14:02:32.322522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:02:32.322522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 69f8c575-d141-465e-a1d6-0a588d798efc could not be found. May 10 14:02:32.322522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '69f8c575-d141-465e-a1d6-0a588d798efc'} May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f8c575-d141-465e-a1d6-0a588d798efc could not be found. May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:02:32.323279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f8c575-d141-465e-a1d6-0a588d798efc could not be found. May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f8c575-d141-465e-a1d6-0a588d798efc could not be found. May 10 14:02:32.326078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:02:32.329997 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-190d6e03-da5b-4dbe-9d8f-4aeb8739f796 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] Returning 404 to user: Instance 69f8c575-d141-465e-a1d6-0a588d798efc could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:02:32.329997 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-190d6e03-da5b-4dbe-9d8f-4aeb8739f796 tempest-VolumesNegativeTest-570253048 tempest-VolumesNegativeTest-570253048-project] 10.222.0.49 "GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc" status: 404 len: 111 microversion: 2.1 time: 0.054857 May 10 14:02:32.341828 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 179/380] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:32 2022] GET /compute/v2.1/servers/69f8c575-d141-465e-a1d6-0a588d798efc => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:02:32.568790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9a1c29f0-55e7-473e-b48c-6243a3db0980 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:32.570437 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9a1c29f0-55e7-473e-b48c-6243a3db0980 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:32.579927 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9a1c29f0-55e7-473e-b48c-6243a3db0980 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.580401 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9a1c29f0-55e7-473e-b48c-6243a3db0980 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.581178 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9a1c29f0-55e7-473e-b48c-6243a3db0980 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.581740 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9a1c29f0-55e7-473e-b48c-6243a3db0980 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.601531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a1d835c3-1df7-4a24-b903-411c80e9ce20 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:32.615346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a1d835c3-1df7-4a24-b903-411c80e9ce20 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.321957 May 10 14:02:32.616995 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 202/381] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:32 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:32.780119 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d6376ff3-2148-43a4-9d47-decca70a5045 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:32.780923 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d6376ff3-2148-43a4-9d47-decca70a5045 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:32.789061 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d6376ff3-2148-43a4-9d47-decca70a5045 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.789764 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d6376ff3-2148-43a4-9d47-decca70a5045 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.790761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d6376ff3-2148-43a4-9d47-decca70a5045 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.791378 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d6376ff3-2148-43a4-9d47-decca70a5045 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.812900 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9a1c29f0-55e7-473e-b48c-6243a3db0980 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:32.821529 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9a1c29f0-55e7-473e-b48c-6243a3db0980 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.258820 May 10 14:02:32.822328 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 180/382] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:32 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:32.836982 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-20b48fe5-5289-4d25-bc4d-e33655ce7bcf tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:32.837592 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-20b48fe5-5289-4d25-bc4d-e33655ce7bcf tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:32.854004 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-20b48fe5-5289-4d25-bc4d-e33655ce7bcf tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.854459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-20b48fe5-5289-4d25-bc4d-e33655ce7bcf tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.857179 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-20b48fe5-5289-4d25-bc4d-e33655ce7bcf tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.858020 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-20b48fe5-5289-4d25-bc4d-e33655ce7bcf tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.893054 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d6376ff3-2148-43a4-9d47-decca70a5045 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:32.904826 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d6376ff3-2148-43a4-9d47-decca70a5045 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1297 microversion: 2.1 time: 0.129236 May 10 14:02:32.915155 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 203/383] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:32 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1297 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:32.953186 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ce376f78-0444-4d89-9ea9-3f90a17fe442 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:32.954074 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ce376f78-0444-4d89-9ea9-3f90a17fe442 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:32.962633 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ce376f78-0444-4d89-9ea9-3f90a17fe442 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.963081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ce376f78-0444-4d89-9ea9-3f90a17fe442 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.963857 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ce376f78-0444-4d89-9ea9-3f90a17fe442 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.969086 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ce376f78-0444-4d89-9ea9-3f90a17fe442 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.025115 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-20b48fe5-5289-4d25-bc4d-e33655ce7bcf tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:33.034342 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-20b48fe5-5289-4d25-bc4d-e33655ce7bcf tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.210840 May 10 14:02:33.035152 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 181/384] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:32 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:33.149818 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c79db178-2b9b-4d0d-8e35-df53ede15f29 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:33.150815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c79db178-2b9b-4d0d-8e35-df53ede15f29 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:33.159286 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c79db178-2b9b-4d0d-8e35-df53ede15f29 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.159926 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c79db178-2b9b-4d0d-8e35-df53ede15f29 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.160910 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c79db178-2b9b-4d0d-8e35-df53ede15f29 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.161851 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c79db178-2b9b-4d0d-8e35-df53ede15f29 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.282404 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ce376f78-0444-4d89-9ea9-3f90a17fe442 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:33.290981 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ce376f78-0444-4d89-9ea9-3f90a17fe442 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:33.292507 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ce376f78-0444-4d89-9ea9-3f90a17fe442 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:33.293671 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ce376f78-0444-4d89-9ea9-3f90a17fe442 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.344512 May 10 14:02:33.308976 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 204/385] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:32 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:33.506045 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c79db178-2b9b-4d0d-8e35-df53ede15f29 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:33.520886 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c79db178-2b9b-4d0d-8e35-df53ede15f29 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.373970 May 10 14:02:33.521910 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 182/386] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:33 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:33.634561 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-428cccd7-dc45-4246-ad26-b6af81517654 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:33.635176 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-428cccd7-dc45-4246-ad26-b6af81517654 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:33.644760 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-428cccd7-dc45-4246-ad26-b6af81517654 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.647093 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-428cccd7-dc45-4246-ad26-b6af81517654 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.647945 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-428cccd7-dc45-4246-ad26-b6af81517654 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.649383 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-428cccd7-dc45-4246-ad26-b6af81517654 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.840435 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b4311a11-20cf-4380-ae6a-3cd1d0613552 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:33.841164 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b4311a11-20cf-4380-ae6a-3cd1d0613552 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:33.862689 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b4311a11-20cf-4380-ae6a-3cd1d0613552 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.863338 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b4311a11-20cf-4380-ae6a-3cd1d0613552 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.864297 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b4311a11-20cf-4380-ae6a-3cd1d0613552 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.864872 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b4311a11-20cf-4380-ae6a-3cd1d0613552 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.916726 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-428cccd7-dc45-4246-ad26-b6af81517654 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:33.928132 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-428cccd7-dc45-4246-ad26-b6af81517654 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.298135 May 10 14:02:33.938047 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 205/387] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:33 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:33.938047 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c8a7513c-d0f0-43c7-ba93-c64971347da3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:33.938555 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c8a7513c-d0f0-43c7-ba93-c64971347da3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:33.945132 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8a7513c-d0f0-43c7-ba93-c64971347da3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.945835 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8a7513c-d0f0-43c7-ba93-c64971347da3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.946884 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8a7513c-d0f0-43c7-ba93-c64971347da3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.947486 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8a7513c-d0f0-43c7-ba93-c64971347da3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.050904 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c8a7513c-d0f0-43c7-ba93-c64971347da3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:34.058650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c8a7513c-d0f0-43c7-ba93-c64971347da3 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1303 microversion: 2.1 time: 0.127296 May 10 14:02:34.060826 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 206/388] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:33 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1303 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:34.069709 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-41c4afa3-18e1-474b-9f9a-878900e8565f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:34.083470 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-41c4afa3-18e1-474b-9f9a-878900e8565f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:34.095671 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41c4afa3-18e1-474b-9f9a-878900e8565f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.096128 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41c4afa3-18e1-474b-9f9a-878900e8565f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.096974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41c4afa3-18e1-474b-9f9a-878900e8565f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.097418 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41c4afa3-18e1-474b-9f9a-878900e8565f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.295217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b4311a11-20cf-4380-ae6a-3cd1d0613552 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:34.303765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b4311a11-20cf-4380-ae6a-3cd1d0613552 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.467659 May 10 14:02:34.307377 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-41c4afa3-18e1-474b-9f9a-878900e8565f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:34.308026 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 183/389] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:33 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:34.320593 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-41c4afa3-18e1-474b-9f9a-878900e8565f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.256546 May 10 14:02:34.326935 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-17686c5d-4e6e-4d93-8785-302cef324a4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:34.329959 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-17686c5d-4e6e-4d93-8785-302cef324a4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:34.333460 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 207/390] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:34 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:34.337334 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-17686c5d-4e6e-4d93-8785-302cef324a4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.338006 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-17686c5d-4e6e-4d93-8785-302cef324a4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.339010 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-17686c5d-4e6e-4d93-8785-302cef324a4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.339415 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-17686c5d-4e6e-4d93-8785-302cef324a4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.539243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-4461d276-2a47-4444-821d-d802a45c3155 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:34.540423 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-4461d276-2a47-4444-821d-d802a45c3155 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:34.551554 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4461d276-2a47-4444-821d-d802a45c3155 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.552636 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4461d276-2a47-4444-821d-d802a45c3155 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.554704 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4461d276-2a47-4444-821d-d802a45c3155 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.555239 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4461d276-2a47-4444-821d-d802a45c3155 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.612578 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-17686c5d-4e6e-4d93-8785-302cef324a4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:34.627815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-17686c5d-4e6e-4d93-8785-302cef324a4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:34.634143 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-17686c5d-4e6e-4d93-8785-302cef324a4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:34.638871 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-17686c5d-4e6e-4d93-8785-302cef324a4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.315275 May 10 14:02:34.650859 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 184/391] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:34 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:34.774295 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-4461d276-2a47-4444-821d-d802a45c3155 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:34.782841 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-4461d276-2a47-4444-821d-d802a45c3155 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.248477 May 10 14:02:34.792520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 208/392] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:34 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:34.948049 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-cf09deb1-6de2-41ad-bbbf-40236652d3ff tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:34.948901 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-cf09deb1-6de2-41ad-bbbf-40236652d3ff tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:34.961251 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cf09deb1-6de2-41ad-bbbf-40236652d3ff tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.962925 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cf09deb1-6de2-41ad-bbbf-40236652d3ff tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.963912 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cf09deb1-6de2-41ad-bbbf-40236652d3ff tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.964519 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cf09deb1-6de2-41ad-bbbf-40236652d3ff tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.077465 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9daa3a3c-1708-45e8-86de-a7e94099cbce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:35.077958 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9daa3a3c-1708-45e8-86de-a7e94099cbce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:35.096527 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9daa3a3c-1708-45e8-86de-a7e94099cbce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.097328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9daa3a3c-1708-45e8-86de-a7e94099cbce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.098345 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9daa3a3c-1708-45e8-86de-a7e94099cbce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.099157 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9daa3a3c-1708-45e8-86de-a7e94099cbce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.261287 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-cf09deb1-6de2-41ad-bbbf-40236652d3ff tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:35.276704 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-cf09deb1-6de2-41ad-bbbf-40236652d3ff tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.334594 May 10 14:02:35.286759 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 185/393] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:34 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:35.328056 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c6d48d86-a386-4838-9808-88f5b244d7c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:35.334252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c6d48d86-a386-4838-9808-88f5b244d7c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:35.349396 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c6d48d86-a386-4838-9808-88f5b244d7c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.350077 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c6d48d86-a386-4838-9808-88f5b244d7c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.353995 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c6d48d86-a386-4838-9808-88f5b244d7c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.354677 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c6d48d86-a386-4838-9808-88f5b244d7c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.366787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9daa3a3c-1708-45e8-86de-a7e94099cbce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:35.387255 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9daa3a3c-1708-45e8-86de-a7e94099cbce tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1370 microversion: 2.1 time: 0.313941 May 10 14:02:35.388292 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 209/394] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:35 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1370 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:35.405673 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c850e431-544b-4a51-a826-ade9326b94f7 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:35.407883 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c850e431-544b-4a51-a826-ade9326b94f7 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:35.420511 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c850e431-544b-4a51-a826-ade9326b94f7 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.421091 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c850e431-544b-4a51-a826-ade9326b94f7 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.426238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c850e431-544b-4a51-a826-ade9326b94f7 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.426777 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c850e431-544b-4a51-a826-ade9326b94f7 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.648700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c850e431-544b-4a51-a826-ade9326b94f7 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:35.661440 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c850e431-544b-4a51-a826-ade9326b94f7 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.261811 May 10 14:02:35.662022 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 210/395] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:35 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:35.674195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-6c552e5d-d926-47ee-bca6-9d1e8ef65c47 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:35.674847 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-6c552e5d-d926-47ee-bca6-9d1e8ef65c47 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:35.686803 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6c552e5d-d926-47ee-bca6-9d1e8ef65c47 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.687180 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6c552e5d-d926-47ee-bca6-9d1e8ef65c47 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.687983 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6c552e5d-d926-47ee-bca6-9d1e8ef65c47 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.688476 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6c552e5d-d926-47ee-bca6-9d1e8ef65c47 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.810587 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c6d48d86-a386-4838-9808-88f5b244d7c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:35.830181 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c6d48d86-a386-4838-9808-88f5b244d7c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.507729 May 10 14:02:35.837079 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 186/396] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:35 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:35.844821 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d3b62a83-4444-4871-9ecc-522b07489641 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:35.845732 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d3b62a83-4444-4871-9ecc-522b07489641 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:35.872954 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d3b62a83-4444-4871-9ecc-522b07489641 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.873698 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d3b62a83-4444-4871-9ecc-522b07489641 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.874751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d3b62a83-4444-4871-9ecc-522b07489641 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.875399 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d3b62a83-4444-4871-9ecc-522b07489641 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.974648 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-6c552e5d-d926-47ee-bca6-9d1e8ef65c47 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:35.982633 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-6c552e5d-d926-47ee-bca6-9d1e8ef65c47 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:35.988018 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-6c552e5d-d926-47ee-bca6-9d1e8ef65c47 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:35.992833 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-6c552e5d-d926-47ee-bca6-9d1e8ef65c47 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.329646 May 10 14:02:35.993520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 211/397] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:35 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:36.189755 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d3b62a83-4444-4871-9ecc-522b07489641 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:36.201080 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d3b62a83-4444-4871-9ecc-522b07489641 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.362352 May 10 14:02:36.203699 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 187/398] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:35 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:36.299741 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5efd93af-7961-49e4-93e3-2884f2c9dd07 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:36.300977 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5efd93af-7961-49e4-93e3-2884f2c9dd07 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:36.313043 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5efd93af-7961-49e4-93e3-2884f2c9dd07 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:36.313910 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5efd93af-7961-49e4-93e3-2884f2c9dd07 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:36.314947 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5efd93af-7961-49e4-93e3-2884f2c9dd07 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:36.315461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5efd93af-7961-49e4-93e3-2884f2c9dd07 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:36.414942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-95ecd303-403b-41d3-b74e-b1c41400c669 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:36.420478 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-95ecd303-403b-41d3-b74e-b1c41400c669 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:36.432423 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-95ecd303-403b-41d3-b74e-b1c41400c669 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:36.434912 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-95ecd303-403b-41d3-b74e-b1c41400c669 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:36.439806 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-95ecd303-403b-41d3-b74e-b1c41400c669 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:36.440015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-95ecd303-403b-41d3-b74e-b1c41400c669 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:36.641763 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5efd93af-7961-49e4-93e3-2884f2c9dd07 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:36.662866 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5efd93af-7961-49e4-93e3-2884f2c9dd07 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.370828 May 10 14:02:36.665096 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 212/399] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:36 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:36.700210 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-4c6fd07b-2406-408e-9d32-25ca0ea779a0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:36.701252 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-4c6fd07b-2406-408e-9d32-25ca0ea779a0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:36.717022 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4c6fd07b-2406-408e-9d32-25ca0ea779a0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:36.717762 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4c6fd07b-2406-408e-9d32-25ca0ea779a0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:36.718785 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4c6fd07b-2406-408e-9d32-25ca0ea779a0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:36.719422 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4c6fd07b-2406-408e-9d32-25ca0ea779a0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:36.889949 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-4c6fd07b-2406-408e-9d32-25ca0ea779a0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:36.899096 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-4c6fd07b-2406-408e-9d32-25ca0ea779a0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.223139 May 10 14:02:36.908787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 213/400] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:36 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:36.908787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-68818751-fbd6-43e4-aa43-dfda1cf6a17a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:36.908787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-68818751-fbd6-43e4-aa43-dfda1cf6a17a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:36.912334 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-68818751-fbd6-43e4-aa43-dfda1cf6a17a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:36.913439 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-68818751-fbd6-43e4-aa43-dfda1cf6a17a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:36.924636 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-68818751-fbd6-43e4-aa43-dfda1cf6a17a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:36.924636 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-68818751-fbd6-43e4-aa43-dfda1cf6a17a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.095596 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-68818751-fbd6-43e4-aa43-dfda1cf6a17a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:37.105564 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-68818751-fbd6-43e4-aa43-dfda1cf6a17a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.204093 May 10 14:02:37.106731 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 214/401] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:36 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:37.112841 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a136ced6-3dd2-4b41-8b5e-9a7f1664e7d0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:37.113679 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a136ced6-3dd2-4b41-8b5e-9a7f1664e7d0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:37.121590 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a136ced6-3dd2-4b41-8b5e-9a7f1664e7d0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.122428 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a136ced6-3dd2-4b41-8b5e-9a7f1664e7d0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.123723 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a136ced6-3dd2-4b41-8b5e-9a7f1664e7d0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.124411 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a136ced6-3dd2-4b41-8b5e-9a7f1664e7d0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.143455 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-95ecd303-403b-41d3-b74e-b1c41400c669 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:37.151913 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-95ecd303-403b-41d3-b74e-b1c41400c669 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1370 microversion: 2.1 time: 0.747815 May 10 14:02:37.165373 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 188/402] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:36 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1370 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:37.170726 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-ec0375c1-d7fa-4cc8-8c92-ee90cf4c654b req-a2a4e3d0-a63d-4842-8934-58739795e0dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a730d46-5e87-4a26-a9fc-4486e99bcf5a", "tag": "f2587919-e230-4e3a-8926-a6478337a26a"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:37.180972 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-ec0375c1-d7fa-4cc8-8c92-ee90cf4c654b req-a2a4e3d0-a63d-4842-8934-58739795e0dc service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.181820 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-ec0375c1-d7fa-4cc8-8c92-ee90cf4c654b req-a2a4e3d0-a63d-4842-8934-58739795e0dc service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.199609 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-ec0375c1-d7fa-4cc8-8c92-ee90cf4c654b req-a2a4e3d0-a63d-4842-8934-58739795e0dc service nova] Creating event network-changed:f2587919-e230-4e3a-8926-a6478337a26a for instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a on hv-cinder-84067 May 10 14:02:37.207300 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-ec0375c1-d7fa-4cc8-8c92-ee90cf4c654b req-a2a4e3d0-a63d-4842-8934-58739795e0dc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040602 May 10 14:02:37.214006 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 189/403] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:37.220022 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6866d93c-9263-4f80-a444-8034b590e7bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:37.221031 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-6866d93c-9263-4f80-a444-8034b590e7bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:37.228006 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6866d93c-9263-4f80-a444-8034b590e7bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.228481 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6866d93c-9263-4f80-a444-8034b590e7bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.229309 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6866d93c-9263-4f80-a444-8034b590e7bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.229907 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6866d93c-9263-4f80-a444-8034b590e7bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.300186 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a136ced6-3dd2-4b41-8b5e-9a7f1664e7d0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:37.309700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a136ced6-3dd2-4b41-8b5e-9a7f1664e7d0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:37.311533 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a136ced6-3dd2-4b41-8b5e-9a7f1664e7d0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:37.312949 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a136ced6-3dd2-4b41-8b5e-9a7f1664e7d0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.205091 May 10 14:02:37.313666 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 215/404] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:37 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:37.422402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6866d93c-9263-4f80-a444-8034b590e7bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:37.431661 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6866d93c-9263-4f80-a444-8034b590e7bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.216077 May 10 14:02:37.432527 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 190/405] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:37 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:37.681121 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-732c2ddd-2934-4193-a7dd-ae227b97072b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:37.682580 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-732c2ddd-2934-4193-a7dd-ae227b97072b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:37.689763 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-732c2ddd-2934-4193-a7dd-ae227b97072b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.690443 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-732c2ddd-2934-4193-a7dd-ae227b97072b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.691441 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-732c2ddd-2934-4193-a7dd-ae227b97072b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.692084 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-732c2ddd-2934-4193-a7dd-ae227b97072b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.860562 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-732c2ddd-2934-4193-a7dd-ae227b97072b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:37.893221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-732c2ddd-2934-4193-a7dd-ae227b97072b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.215074 May 10 14:02:37.908068 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 216/406] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:37 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:37.919006 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7537134a-23b6-44c5-9367-8d4de6c21684 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:37.920036 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7537134a-23b6-44c5-9367-8d4de6c21684 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:37.938115 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7537134a-23b6-44c5-9367-8d4de6c21684 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.938728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7537134a-23b6-44c5-9367-8d4de6c21684 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.939678 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7537134a-23b6-44c5-9367-8d4de6c21684 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.940290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7537134a-23b6-44c5-9367-8d4de6c21684 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.100369 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-43a68c9c-1752-421d-ab8d-fab9948b6a80 req-1f1603e4-21f3-48ec-94bb-33efd80c068b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa06f26-fa96-4753-9ea2-c2abecdb7087", "name": "network-vif-plugged", "status": "completed", "tag": "156485a6-4fc0-40bc-a3c8-0aa824e3cae2"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:38.111301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-43a68c9c-1752-421d-ab8d-fab9948b6a80 req-1f1603e4-21f3-48ec-94bb-33efd80c068b service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.111792 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-43a68c9c-1752-421d-ab8d-fab9948b6a80 req-1f1603e4-21f3-48ec-94bb-33efd80c068b service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.137773 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-43a68c9c-1752-421d-ab8d-fab9948b6a80 req-1f1603e4-21f3-48ec-94bb-33efd80c068b service nova] Creating event network-vif-plugged:156485a6-4fc0-40bc-a3c8-0aa824e3cae2 for instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 on hv-cinder-84067 May 10 14:02:38.143182 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-43a68c9c-1752-421d-ab8d-fab9948b6a80 req-1f1603e4-21f3-48ec-94bb-33efd80c068b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046742 May 10 14:02:38.146160 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 217/407] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:02:38.159274 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c649febb-dc76-4901-b28b-4a5af79ba4d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:38.160601 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c649febb-dc76-4901-b28b-4a5af79ba4d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:38.172417 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c649febb-dc76-4901-b28b-4a5af79ba4d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.173755 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c649febb-dc76-4901-b28b-4a5af79ba4d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.174749 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c649febb-dc76-4901-b28b-4a5af79ba4d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.175549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c649febb-dc76-4901-b28b-4a5af79ba4d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.265458 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7537134a-23b6-44c5-9367-8d4de6c21684 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:38.277808 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7537134a-23b6-44c5-9367-8d4de6c21684 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.361341 May 10 14:02:38.278776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 191/408] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:37 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:38.291345 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f5780678-1ae8-4997-a474-e5f2e0a9d801 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:38.295906 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f5780678-1ae8-4997-a474-e5f2e0a9d801 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:38.313740 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f5780678-1ae8-4997-a474-e5f2e0a9d801 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.319842 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f5780678-1ae8-4997-a474-e5f2e0a9d801 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.321126 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f5780678-1ae8-4997-a474-e5f2e0a9d801 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.321839 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f5780678-1ae8-4997-a474-e5f2e0a9d801 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.463194 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c649febb-dc76-4901-b28b-4a5af79ba4d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:38.472842 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c649febb-dc76-4901-b28b-4a5af79ba4d1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.324226 May 10 14:02:38.474124 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 218/409] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:38 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:38.480012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0e950e2a-b157-4beb-95fe-1aaeac30c38a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:38.483435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0e950e2a-b157-4beb-95fe-1aaeac30c38a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:38.489573 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e950e2a-b157-4beb-95fe-1aaeac30c38a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.500325 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e950e2a-b157-4beb-95fe-1aaeac30c38a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.501740 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e950e2a-b157-4beb-95fe-1aaeac30c38a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.502354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e950e2a-b157-4beb-95fe-1aaeac30c38a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.666217 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0e950e2a-b157-4beb-95fe-1aaeac30c38a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:38.685240 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0e950e2a-b157-4beb-95fe-1aaeac30c38a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:38.689393 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f5780678-1ae8-4997-a474-e5f2e0a9d801 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:38.692272 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0e950e2a-b157-4beb-95fe-1aaeac30c38a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:38.695948 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0e950e2a-b157-4beb-95fe-1aaeac30c38a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.217757 May 10 14:02:38.697734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f5780678-1ae8-4997-a474-e5f2e0a9d801 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1370 microversion: 2.1 time: 0.417652 May 10 14:02:38.698302 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 192/410] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:38 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1370 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:38.707776 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 219/411] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:38 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:38.714145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-135b9336-6b16-4582-990c-b036b3eac85a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:38.714756 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-135b9336-6b16-4582-990c-b036b3eac85a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:38.721883 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-135b9336-6b16-4582-990c-b036b3eac85a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.722774 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-135b9336-6b16-4582-990c-b036b3eac85a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.724157 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-135b9336-6b16-4582-990c-b036b3eac85a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.724808 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-135b9336-6b16-4582-990c-b036b3eac85a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.921580 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-61b7696f-65ef-4ae9-a948-ad9167a3424a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:38.923499 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-135b9336-6b16-4582-990c-b036b3eac85a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:38.924011 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-61b7696f-65ef-4ae9-a948-ad9167a3424a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:38.935492 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-135b9336-6b16-4582-990c-b036b3eac85a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.236121 May 10 14:02:38.936084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 193/412] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:38 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:38.939521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-61b7696f-65ef-4ae9-a948-ad9167a3424a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.939987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-61b7696f-65ef-4ae9-a948-ad9167a3424a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.940817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-61b7696f-65ef-4ae9-a948-ad9167a3424a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.941257 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-61b7696f-65ef-4ae9-a948-ad9167a3424a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.161468 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-61b7696f-65ef-4ae9-a948-ad9167a3424a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:39.171626 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-61b7696f-65ef-4ae9-a948-ad9167a3424a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.264027 May 10 14:02:39.172560 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 220/413] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:38 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:39.297841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-47cdc0b5-8812-4d4e-8702-bfec64a67f36 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:39.299235 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-47cdc0b5-8812-4d4e-8702-bfec64a67f36 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:39.306917 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-47cdc0b5-8812-4d4e-8702-bfec64a67f36 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.307732 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-47cdc0b5-8812-4d4e-8702-bfec64a67f36 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.308777 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-47cdc0b5-8812-4d4e-8702-bfec64a67f36 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.309438 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-47cdc0b5-8812-4d4e-8702-bfec64a67f36 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.469588 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-47cdc0b5-8812-4d4e-8702-bfec64a67f36 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:39.478259 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-47cdc0b5-8812-4d4e-8702-bfec64a67f36 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.184733 May 10 14:02:39.494612 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-447ae525-6adc-44cb-b63f-08be7536f03f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:39.495513 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-447ae525-6adc-44cb-b63f-08be7536f03f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:39.501713 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-447ae525-6adc-44cb-b63f-08be7536f03f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.502613 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 194/414] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:39 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:39.502740 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-447ae525-6adc-44cb-b63f-08be7536f03f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.503393 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-447ae525-6adc-44cb-b63f-08be7536f03f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.503941 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-447ae525-6adc-44cb-b63f-08be7536f03f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.665967 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-447ae525-6adc-44cb-b63f-08be7536f03f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:39.675079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-447ae525-6adc-44cb-b63f-08be7536f03f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.185441 May 10 14:02:39.676400 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 221/415] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:39 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:39.714846 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-825ed795-b4ce-428e-afe3-e0cd08b52efa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:39.715452 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-825ed795-b4ce-428e-afe3-e0cd08b52efa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:39.720802 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-b2f3b222-329a-4b1c-99cd-3d52ce662c3d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:39.721984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-b2f3b222-329a-4b1c-99cd-3d52ce662c3d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:39.729950 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-825ed795-b4ce-428e-afe3-e0cd08b52efa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.730124 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b2f3b222-329a-4b1c-99cd-3d52ce662c3d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.730399 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-825ed795-b4ce-428e-afe3-e0cd08b52efa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.731011 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b2f3b222-329a-4b1c-99cd-3d52ce662c3d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.731182 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-825ed795-b4ce-428e-afe3-e0cd08b52efa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.731598 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-825ed795-b4ce-428e-afe3-e0cd08b52efa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.732328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b2f3b222-329a-4b1c-99cd-3d52ce662c3d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.732885 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b2f3b222-329a-4b1c-99cd-3d52ce662c3d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.922221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-825ed795-b4ce-428e-afe3-e0cd08b52efa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:39.930136 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-825ed795-b4ce-428e-afe3-e0cd08b52efa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:39.931966 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-825ed795-b4ce-428e-afe3-e0cd08b52efa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:39.933406 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-825ed795-b4ce-428e-afe3-e0cd08b52efa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.222450 May 10 14:02:39.934592 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 195/416] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:39 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:39.950240 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-b2f3b222-329a-4b1c-99cd-3d52ce662c3d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:39.953263 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-82b0db73-cee8-4c98-b4e5-e083c754e104 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:39.954129 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-82b0db73-cee8-4c98-b4e5-e083c754e104 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:39.960835 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-b2f3b222-329a-4b1c-99cd-3d52ce662c3d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1370 microversion: 2.1 time: 0.244024 May 10 14:02:39.961522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82b0db73-cee8-4c98-b4e5-e083c754e104 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.961965 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 222/417] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:39 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:39.962088 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82b0db73-cee8-4c98-b4e5-e083c754e104 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.962979 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82b0db73-cee8-4c98-b4e5-e083c754e104 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.963512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82b0db73-cee8-4c98-b4e5-e083c754e104 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.125065 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-82b0db73-cee8-4c98-b4e5-e083c754e104 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:40.133600 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-82b0db73-cee8-4c98-b4e5-e083c754e104 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.184354 May 10 14:02:40.134361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 196/418] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:39 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:40.169609 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-4f7fe849-a672-41a7-810d-63d61cec3de5 req-b6f39286-6da7-4693-b477-0c7b89a91e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8821a821-144b-4a72-b16e-07014a8063d0", "name": "network-vif-plugged", "status": "completed", "tag": "12100075-8151-4b48-9d14-6864846987d2"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:40.178122 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-4f7fe849-a672-41a7-810d-63d61cec3de5 req-b6f39286-6da7-4693-b477-0c7b89a91e68 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.178712 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-4f7fe849-a672-41a7-810d-63d61cec3de5 req-b6f39286-6da7-4693-b477-0c7b89a91e68 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.189966 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-15e9aaa5-b2b2-45e4-9be9-f322067d625c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:40.190780 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-15e9aaa5-b2b2-45e4-9be9-f322067d625c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:40.190898 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-4f7fe849-a672-41a7-810d-63d61cec3de5 req-b6f39286-6da7-4693-b477-0c7b89a91e68 service nova] Creating event network-vif-plugged:12100075-8151-4b48-9d14-6864846987d2 for instance 8821a821-144b-4a72-b16e-07014a8063d0 on hv-cinder-84067 May 10 14:02:40.197807 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-4f7fe849-a672-41a7-810d-63d61cec3de5 req-b6f39286-6da7-4693-b477-0c7b89a91e68 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031756 May 10 14:02:40.198799 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 223/419] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:40.200191 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-15e9aaa5-b2b2-45e4-9be9-f322067d625c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.201411 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-15e9aaa5-b2b2-45e4-9be9-f322067d625c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.201904 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-15e9aaa5-b2b2-45e4-9be9-f322067d625c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.202464 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-15e9aaa5-b2b2-45e4-9be9-f322067d625c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.353437 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-15e9aaa5-b2b2-45e4-9be9-f322067d625c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:40.362391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-15e9aaa5-b2b2-45e4-9be9-f322067d625c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.176061 May 10 14:02:40.363128 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 197/420] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:40 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:40.496327 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0d4e2a02-0fe9-47d7-8354-2ebc57265d59 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:40.497049 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0d4e2a02-0fe9-47d7-8354-2ebc57265d59 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:40.503461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0d4e2a02-0fe9-47d7-8354-2ebc57265d59 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.503912 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0d4e2a02-0fe9-47d7-8354-2ebc57265d59 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.504767 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0d4e2a02-0fe9-47d7-8354-2ebc57265d59 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.505213 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0d4e2a02-0fe9-47d7-8354-2ebc57265d59 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.673657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0d4e2a02-0fe9-47d7-8354-2ebc57265d59 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:40.685645 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0d4e2a02-0fe9-47d7-8354-2ebc57265d59 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.191398 May 10 14:02:40.686378 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 224/421] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:40 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:40.699684 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3c8e144b-618e-4a53-9202-16cefa02723c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:40.700795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-3c8e144b-618e-4a53-9202-16cefa02723c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:40.716207 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3c8e144b-618e-4a53-9202-16cefa02723c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.716207 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3c8e144b-618e-4a53-9202-16cefa02723c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.716629 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3c8e144b-618e-4a53-9202-16cefa02723c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.717394 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3c8e144b-618e-4a53-9202-16cefa02723c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.893623 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3c8e144b-618e-4a53-9202-16cefa02723c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:40.901824 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3c8e144b-618e-4a53-9202-16cefa02723c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.210701 May 10 14:02:40.911960 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 198/422] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:40 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:40.952466 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-42cd9c3f-85d6-4d50-8fda-e483a3f6e508 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:40.954429 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-42cd9c3f-85d6-4d50-8fda-e483a3f6e508 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:40.960920 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-42cd9c3f-85d6-4d50-8fda-e483a3f6e508 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.961675 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-42cd9c3f-85d6-4d50-8fda-e483a3f6e508 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.962685 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-42cd9c3f-85d6-4d50-8fda-e483a3f6e508 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.963335 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-42cd9c3f-85d6-4d50-8fda-e483a3f6e508 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.985246 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9d72af28-c7cd-4577-9f96-8464d86c9c9c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:40.986152 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9d72af28-c7cd-4577-9f96-8464d86c9c9c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:40.993207 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9d72af28-c7cd-4577-9f96-8464d86c9c9c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.994455 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9d72af28-c7cd-4577-9f96-8464d86c9c9c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.995326 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9d72af28-c7cd-4577-9f96-8464d86c9c9c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.996079 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9d72af28-c7cd-4577-9f96-8464d86c9c9c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:41.161243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-42cd9c3f-85d6-4d50-8fda-e483a3f6e508 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:41.170969 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-42cd9c3f-85d6-4d50-8fda-e483a3f6e508 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:41.172594 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-42cd9c3f-85d6-4d50-8fda-e483a3f6e508 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:41.173915 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-42cd9c3f-85d6-4d50-8fda-e483a3f6e508 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.225366 May 10 14:02:41.184873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 225/423] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:40 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:41.189479 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9d72af28-c7cd-4577-9f96-8464d86c9c9c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:41.197180 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9d72af28-c7cd-4577-9f96-8464d86c9c9c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1370 microversion: 2.1 time: 0.219005 May 10 14:02:41.201269 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-28ea93d6-e9cc-4f43-9d33-38c5c3d18f42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:41.202373 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 199/424] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:40 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:41.203243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-28ea93d6-e9cc-4f43-9d33-38c5c3d18f42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:41.210144 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28ea93d6-e9cc-4f43-9d33-38c5c3d18f42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:41.210863 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28ea93d6-e9cc-4f43-9d33-38c5c3d18f42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:41.211827 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28ea93d6-e9cc-4f43-9d33-38c5c3d18f42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:41.212532 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28ea93d6-e9cc-4f43-9d33-38c5c3d18f42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:41.361587 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-28ea93d6-e9cc-4f43-9d33-38c5c3d18f42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:41.369634 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-28ea93d6-e9cc-4f43-9d33-38c5c3d18f42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1367 microversion: 2.1 time: 0.182991 May 10 14:02:41.370807 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 226/425] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:41 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:41.385295 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-73414126-d9b9-4619-aacc-f4119a9536b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:41.386615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-73414126-d9b9-4619-aacc-f4119a9536b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:41.400339 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-73414126-d9b9-4619-aacc-f4119a9536b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:41.401906 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-73414126-d9b9-4619-aacc-f4119a9536b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:41.403163 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-73414126-d9b9-4619-aacc-f4119a9536b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:41.403914 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-73414126-d9b9-4619-aacc-f4119a9536b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:41.553848 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-73414126-d9b9-4619-aacc-f4119a9536b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:41.563067 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-73414126-d9b9-4619-aacc-f4119a9536b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.182068 May 10 14:02:41.563968 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 200/426] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:41 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:41.714412 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f42062d9-2c69-4d14-a9dc-7ae4e347fa5c tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:41.715467 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f42062d9-2c69-4d14-a9dc-7ae4e347fa5c tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:41.725494 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f42062d9-2c69-4d14-a9dc-7ae4e347fa5c tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:41.726281 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f42062d9-2c69-4d14-a9dc-7ae4e347fa5c tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:41.727174 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f42062d9-2c69-4d14-a9dc-7ae4e347fa5c tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:41.727705 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f42062d9-2c69-4d14-a9dc-7ae4e347fa5c tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:41.882534 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f42062d9-2c69-4d14-a9dc-7ae4e347fa5c tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:41.891039 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f42062d9-2c69-4d14-a9dc-7ae4e347fa5c tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.182433 May 10 14:02:41.892260 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 227/427] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:41 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:41.920127 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-96744c51-bf82-480a-ac8f-b81109158690 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:41.920795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-96744c51-bf82-480a-ac8f-b81109158690 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:41.927584 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-96744c51-bf82-480a-ac8f-b81109158690 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:41.928526 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-96744c51-bf82-480a-ac8f-b81109158690 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:41.929255 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-96744c51-bf82-480a-ac8f-b81109158690 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:41.929810 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-96744c51-bf82-480a-ac8f-b81109158690 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.079880 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-96744c51-bf82-480a-ac8f-b81109158690 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:42.089478 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-96744c51-bf82-480a-ac8f-b81109158690 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.173337 May 10 14:02:42.096592 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 201/428] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:41 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:42.193283 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5cc184d9-b66a-4b85-aa54-527d5d600309 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:42.194637 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5cc184d9-b66a-4b85-aa54-527d5d600309 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:42.202216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5cc184d9-b66a-4b85-aa54-527d5d600309 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.207016 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5cc184d9-b66a-4b85-aa54-527d5d600309 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.213496 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-28132f1d-0da9-4e43-a269-0fe1d922f68c req-fcc43e0f-840c-4804-90ee-818eceda2793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2288a3f8-70db-4951-acaf-f839a42ed73b", "name": "network-vif-plugged", "status": "completed", "tag": "ec56af2f-6e36-458b-8cbf-61f578a6cae0"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:42.219446 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5cc184d9-b66a-4b85-aa54-527d5d600309 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.223131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-28132f1d-0da9-4e43-a269-0fe1d922f68c req-fcc43e0f-840c-4804-90ee-818eceda2793 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.223774 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5cc184d9-b66a-4b85-aa54-527d5d600309 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.230823 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-28132f1d-0da9-4e43-a269-0fe1d922f68c req-fcc43e0f-840c-4804-90ee-818eceda2793 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.258342 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-28132f1d-0da9-4e43-a269-0fe1d922f68c req-fcc43e0f-840c-4804-90ee-818eceda2793 service nova] Creating event network-vif-plugged:ec56af2f-6e36-458b-8cbf-61f578a6cae0 for instance 2288a3f8-70db-4951-acaf-f839a42ed73b on hv-cinder-84067 May 10 14:02:42.268857 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-28132f1d-0da9-4e43-a269-0fe1d922f68c req-fcc43e0f-840c-4804-90ee-818eceda2793 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059345 May 10 14:02:42.270094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 202/429] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:42.277036 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-09e31ab2-27fa-4a46-bb52-96d3d0e0d48e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:42.277918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-09e31ab2-27fa-4a46-bb52-96d3d0e0d48e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:42.284202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-09e31ab2-27fa-4a46-bb52-96d3d0e0d48e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.284853 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-09e31ab2-27fa-4a46-bb52-96d3d0e0d48e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.285794 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-09e31ab2-27fa-4a46-bb52-96d3d0e0d48e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.286392 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-09e31ab2-27fa-4a46-bb52-96d3d0e0d48e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.387526 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5cc184d9-b66a-4b85-aa54-527d5d600309 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:42.405666 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5cc184d9-b66a-4b85-aa54-527d5d600309 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:42.407378 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5cc184d9-b66a-4b85-aa54-527d5d600309 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:42.408955 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5cc184d9-b66a-4b85-aa54-527d5d600309 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.219584 May 10 14:02:42.420539 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 228/430] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:42 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:02:42.425734 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f53b46ac-fdce-4005-94c9-5864b637b6b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:42.426708 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f53b46ac-fdce-4005-94c9-5864b637b6b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:42.438682 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f53b46ac-fdce-4005-94c9-5864b637b6b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.440371 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f53b46ac-fdce-4005-94c9-5864b637b6b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.441437 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f53b46ac-fdce-4005-94c9-5864b637b6b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.442239 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f53b46ac-fdce-4005-94c9-5864b637b6b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.470815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-09e31ab2-27fa-4a46-bb52-96d3d0e0d48e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:42.478711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-09e31ab2-27fa-4a46-bb52-96d3d0e0d48e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1370 microversion: 2.1 time: 0.207159 May 10 14:02:42.479295 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 203/431] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:42 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:42.581044 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-28b83256-1323-4b56-8995-b20f3918de1e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:42.581648 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-28b83256-1323-4b56-8995-b20f3918de1e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:42.588934 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-28b83256-1323-4b56-8995-b20f3918de1e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.589603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-28b83256-1323-4b56-8995-b20f3918de1e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.590571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-28b83256-1323-4b56-8995-b20f3918de1e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.591155 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-28b83256-1323-4b56-8995-b20f3918de1e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.607518 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f53b46ac-fdce-4005-94c9-5864b637b6b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:42.618591 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f53b46ac-fdce-4005-94c9-5864b637b6b5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1558 microversion: 2.1 time: 0.196654 May 10 14:02:42.630541 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 229/432] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:42 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:42.638552 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-932ea87a-da16-41e7-a65d-3fce8ab2b673 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:42.640159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-932ea87a-da16-41e7-a65d-3fce8ab2b673 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:42.648480 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-932ea87a-da16-41e7-a65d-3fce8ab2b673 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.648931 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-932ea87a-da16-41e7-a65d-3fce8ab2b673 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.649716 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-932ea87a-da16-41e7-a65d-3fce8ab2b673 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.650150 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-932ea87a-da16-41e7-a65d-3fce8ab2b673 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.763883 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-932ea87a-da16-41e7-a65d-3fce8ab2b673 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132166 May 10 14:02:42.764753 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 230/433] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 14:02:42 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:42.773476 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-28b83256-1323-4b56-8995-b20f3918de1e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:42.783427 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-28b83256-1323-4b56-8995-b20f3918de1e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.206110 May 10 14:02:42.788644 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 204/434] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:42 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:42.910904 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2bda8e35-548c-4e51-ae40-ccc3a6ab841a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:42.912301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2bda8e35-548c-4e51-ae40-ccc3a6ab841a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:42.931003 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2bda8e35-548c-4e51-ae40-ccc3a6ab841a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.931468 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2bda8e35-548c-4e51-ae40-ccc3a6ab841a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.932281 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2bda8e35-548c-4e51-ae40-ccc3a6ab841a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.932734 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2bda8e35-548c-4e51-ae40-ccc3a6ab841a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:43.106540 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-669dbd74-70c2-4525-869a-74b1ac03458d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:43.107401 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-669dbd74-70c2-4525-869a-74b1ac03458d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:43.124445 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-669dbd74-70c2-4525-869a-74b1ac03458d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:43.125144 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-669dbd74-70c2-4525-869a-74b1ac03458d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:43.126111 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-669dbd74-70c2-4525-869a-74b1ac03458d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:43.126695 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-669dbd74-70c2-4525-869a-74b1ac03458d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:43.267879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2bda8e35-548c-4e51-ae40-ccc3a6ab841a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:43.277675 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2bda8e35-548c-4e51-ae40-ccc3a6ab841a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1358 microversion: 2.1 time: 0.372130 May 10 14:02:43.289997 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 231/435] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:42 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1358 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:43.306490 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-669dbd74-70c2-4525-869a-74b1ac03458d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:43.314152 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-669dbd74-70c2-4525-869a-74b1ac03458d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.211584 May 10 14:02:43.316023 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 205/436] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:43 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:43.427139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-da3b11da-09f3-4476-a437-e2b30d1ba2f5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:43.427779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-da3b11da-09f3-4476-a437-e2b30d1ba2f5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:43.434686 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-da3b11da-09f3-4476-a437-e2b30d1ba2f5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:43.445531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-da3b11da-09f3-4476-a437-e2b30d1ba2f5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:43.446384 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-da3b11da-09f3-4476-a437-e2b30d1ba2f5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:43.446823 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-da3b11da-09f3-4476-a437-e2b30d1ba2f5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:43.499000 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-40952ce6-81c3-4e52-91e8-d1940bb3fb42 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:43.500403 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-40952ce6-81c3-4e52-91e8-d1940bb3fb42 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:43.509952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40952ce6-81c3-4e52-91e8-d1940bb3fb42 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:43.511065 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40952ce6-81c3-4e52-91e8-d1940bb3fb42 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:43.512238 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40952ce6-81c3-4e52-91e8-d1940bb3fb42 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:43.512841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40952ce6-81c3-4e52-91e8-d1940bb3fb42 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:43.717593 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-da3b11da-09f3-4476-a437-e2b30d1ba2f5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:43.728358 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-da3b11da-09f3-4476-a437-e2b30d1ba2f5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:43.730187 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-da3b11da-09f3-4476-a437-e2b30d1ba2f5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:43.731376 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-da3b11da-09f3-4476-a437-e2b30d1ba2f5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.308492 May 10 14:02:43.743837 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 232/437] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:43 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:43.792831 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-40952ce6-81c3-4e52-91e8-d1940bb3fb42 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:43.802642 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-40952ce6-81c3-4e52-91e8-d1940bb3fb42 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1370 microversion: 2.1 time: 0.307527 May 10 14:02:43.804262 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 206/438] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:43 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:43.806520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-872ce5f9-76c4-4e57-8cf4-6d4a2f97c60d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:43.807165 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-872ce5f9-76c4-4e57-8cf4-6d4a2f97c60d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:43.848633 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-872ce5f9-76c4-4e57-8cf4-6d4a2f97c60d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:43.849189 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-872ce5f9-76c4-4e57-8cf4-6d4a2f97c60d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:43.854918 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-872ce5f9-76c4-4e57-8cf4-6d4a2f97c60d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:43.857432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-872ce5f9-76c4-4e57-8cf4-6d4a2f97c60d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.218140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-872ce5f9-76c4-4e57-8cf4-6d4a2f97c60d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:44.231606 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-872ce5f9-76c4-4e57-8cf4-6d4a2f97c60d tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.432695 May 10 14:02:44.244782 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 233/439] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:43 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:44.298221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7154a1e1-76ee-442e-9299-d04cde764361 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:44.299155 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7154a1e1-76ee-442e-9299-d04cde764361 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:44.306217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7154a1e1-76ee-442e-9299-d04cde764361 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.307178 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7154a1e1-76ee-442e-9299-d04cde764361 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.308144 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7154a1e1-76ee-442e-9299-d04cde764361 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.308802 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7154a1e1-76ee-442e-9299-d04cde764361 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.332039 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d60031b9-c914-445b-aabf-c317880ca888 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:44.333400 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d60031b9-c914-445b-aabf-c317880ca888 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:44.342296 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d60031b9-c914-445b-aabf-c317880ca888 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.347658 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d60031b9-c914-445b-aabf-c317880ca888 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.348794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d60031b9-c914-445b-aabf-c317880ca888 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.349456 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d60031b9-c914-445b-aabf-c317880ca888 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.505989 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7154a1e1-76ee-442e-9299-d04cde764361 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:44.514504 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7154a1e1-76ee-442e-9299-d04cde764361 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1548 microversion: 2.1 time: 0.220339 May 10 14:02:44.516842 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 207/440] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:44 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1548 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:44.534113 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9ceaf7c6-a8bf-4868-b2e4-281f2ad0885f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:44.535127 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9ceaf7c6-a8bf-4868-b2e4-281f2ad0885f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:44.542802 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9ceaf7c6-a8bf-4868-b2e4-281f2ad0885f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.543579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9ceaf7c6-a8bf-4868-b2e4-281f2ad0885f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.544628 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9ceaf7c6-a8bf-4868-b2e4-281f2ad0885f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.545296 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9ceaf7c6-a8bf-4868-b2e4-281f2ad0885f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.648343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d60031b9-c914-445b-aabf-c317880ca888 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:44.657714 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d60031b9-c914-445b-aabf-c317880ca888 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1265 microversion: 2.1 time: 0.329404 May 10 14:02:44.658363 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 234/441] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:44 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1265 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:44.709019 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9ceaf7c6-a8bf-4868-b2e4-281f2ad0885f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:44.717687 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9ceaf7c6-a8bf-4868-b2e4-281f2ad0885f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1548 microversion: 2.1 time: 0.187771 May 10 14:02:44.718261 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 208/442] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:44 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1548 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:44.733176 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c48a221e-533c-45f0-969b-ad36b602e37b tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:44.736678 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c48a221e-533c-45f0-969b-ad36b602e37b tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:44.737427 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c48a221e-533c-45f0-969b-ad36b602e37b tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Searching by: {'deleted': False, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169'} {{(pid=117154) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 14:02:44.743908 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c48a221e-533c-45f0-969b-ad36b602e37b tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.744386 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c48a221e-533c-45f0-969b-ad36b602e37b tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.745564 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c48a221e-533c-45f0-969b-ad36b602e37b tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.746387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c48a221e-533c-45f0-969b-ad36b602e37b tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.750424 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-10d8e663-145a-4f38-80c6-f5f530a67898 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:44.751037 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-10d8e663-145a-4f38-80c6-f5f530a67898 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:44.757531 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-10d8e663-145a-4f38-80c6-f5f530a67898 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.757978 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-10d8e663-145a-4f38-80c6-f5f530a67898 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.758756 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-10d8e663-145a-4f38-80c6-f5f530a67898 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.759252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-10d8e663-145a-4f38-80c6-f5f530a67898 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.841283 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.multi_cell_list [None req-c48a221e-533c-45f0-969b-ad36b602e37b tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117154) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 14:02:44.898204 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-10d8e663-145a-4f38-80c6-f5f530a67898 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:44.906363 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-10d8e663-145a-4f38-80c6-f5f530a67898 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:44.908200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-10d8e663-145a-4f38-80c6-f5f530a67898 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:44.909474 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-10d8e663-145a-4f38-80c6-f5f530a67898 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1738 microversion: 2.20 time: 0.162964 May 10 14:02:44.910324 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 209/443] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:44 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:02:44.914763 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-1afebe12-e223-452a-b84e-e6063b89f351 req-a2a6ab3d-cf1f-4ca2-963f-a61632a5cbcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa06f26-fa96-4753-9ea2-c2abecdb7087", "tag": "156485a6-4fc0-40bc-a3c8-0aa824e3cae2"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:44.922581 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-1afebe12-e223-452a-b84e-e6063b89f351 req-a2a6ab3d-cf1f-4ca2-963f-a61632a5cbcb service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.923029 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-1afebe12-e223-452a-b84e-e6063b89f351 req-a2a6ab3d-cf1f-4ca2-963f-a61632a5cbcb service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.935168 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-1afebe12-e223-452a-b84e-e6063b89f351 req-a2a6ab3d-cf1f-4ca2-963f-a61632a5cbcb service nova] Creating event network-changed:156485a6-4fc0-40bc-a3c8-0aa824e3cae2 for instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 on hv-cinder-84067 May 10 14:02:44.940116 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-1afebe12-e223-452a-b84e-e6063b89f351 req-a2a6ab3d-cf1f-4ca2-963f-a61632a5cbcb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028931 May 10 14:02:44.941054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 210/444] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:44.949265 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9acd76e1-58b2-4a65-8b21-6b6dde0b8e36 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:44.950939 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9acd76e1-58b2-4a65-8b21-6b6dde0b8e36 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:44.956720 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9acd76e1-58b2-4a65-8b21-6b6dde0b8e36 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.957219 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9acd76e1-58b2-4a65-8b21-6b6dde0b8e36 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.958081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9acd76e1-58b2-4a65-8b21-6b6dde0b8e36 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.958511 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9acd76e1-58b2-4a65-8b21-6b6dde0b8e36 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.966361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c48a221e-533c-45f0-969b-ad36b602e37b tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.236886 May 10 14:02:44.967071 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 235/445] 10.222.0.49 () {58 vars in 1124 bytes} [Tue May 10 14:02:44 2022] GET /compute/v2.1/servers => generated 342 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:44.976880 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-68df14e3-e816-4906-9269-3a4d3a9bdb86 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:44.977473 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-68df14e3-e816-4906-9269-3a4d3a9bdb86 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:44.983116 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-68df14e3-e816-4906-9269-3a4d3a9bdb86 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.983644 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-68df14e3-e816-4906-9269-3a4d3a9bdb86 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.984373 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-68df14e3-e816-4906-9269-3a4d3a9bdb86 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.984813 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-68df14e3-e816-4906-9269-3a4d3a9bdb86 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:45.136495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-68df14e3-e816-4906-9269-3a4d3a9bdb86 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:45.138034 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9acd76e1-58b2-4a65-8b21-6b6dde0b8e36 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:45.143798 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-68df14e3-e816-4906-9269-3a4d3a9bdb86 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1548 microversion: 2.1 time: 0.170534 May 10 14:02:45.144600 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 236/446] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:44 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:45.146548 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9acd76e1-58b2-4a65-8b21-6b6dde0b8e36 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1370 microversion: 2.1 time: 0.200843 May 10 14:02:45.147726 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 211/447] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:44 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:45.249927 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a97177d6-7366-4586-9224-e5cd3b551feb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:45.250675 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a97177d6-7366-4586-9224-e5cd3b551feb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:45.261638 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a97177d6-7366-4586-9224-e5cd3b551feb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:45.262098 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a97177d6-7366-4586-9224-e5cd3b551feb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:45.262894 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a97177d6-7366-4586-9224-e5cd3b551feb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:45.263337 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a97177d6-7366-4586-9224-e5cd3b551feb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:45.437622 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a97177d6-7366-4586-9224-e5cd3b551feb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:45.446320 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a97177d6-7366-4586-9224-e5cd3b551feb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.200384 May 10 14:02:45.449448 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 237/448] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:45 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:45.673460 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e8bb393e-7ac9-4094-b5ee-a81107cd4203 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:45.675159 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e8bb393e-7ac9-4094-b5ee-a81107cd4203 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:45.681193 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e8bb393e-7ac9-4094-b5ee-a81107cd4203 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:45.681643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e8bb393e-7ac9-4094-b5ee-a81107cd4203 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:45.682417 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e8bb393e-7ac9-4094-b5ee-a81107cd4203 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:45.682849 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e8bb393e-7ac9-4094-b5ee-a81107cd4203 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:45.876902 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e8bb393e-7ac9-4094-b5ee-a81107cd4203 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:45.885341 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e8bb393e-7ac9-4094-b5ee-a81107cd4203 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1452 microversion: 2.1 time: 0.215713 May 10 14:02:45.886147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 212/449] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:45 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1452 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:45.901851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-abdd9a77-6fcf-410b-b223-229a81190d1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:45.902462 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-abdd9a77-6fcf-410b-b223-229a81190d1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:45.908971 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-abdd9a77-6fcf-410b-b223-229a81190d1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:45.909427 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-abdd9a77-6fcf-410b-b223-229a81190d1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:45.910244 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-abdd9a77-6fcf-410b-b223-229a81190d1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:45.910633 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-abdd9a77-6fcf-410b-b223-229a81190d1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:45.931339 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0d36a123-1f9a-4f58-a089-efe450763add tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:45.932407 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0d36a123-1f9a-4f58-a089-efe450763add tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:45.938762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d36a123-1f9a-4f58-a089-efe450763add tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:45.939439 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d36a123-1f9a-4f58-a089-efe450763add tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:45.940456 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d36a123-1f9a-4f58-a089-efe450763add tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:45.941064 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d36a123-1f9a-4f58-a089-efe450763add tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:46.075102 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-abdd9a77-6fcf-410b-b223-229a81190d1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:46.083566 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-abdd9a77-6fcf-410b-b223-229a81190d1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1452 microversion: 2.1 time: 0.185565 May 10 14:02:46.084464 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 238/450] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:45 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:46.106651 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0d36a123-1f9a-4f58-a089-efe450763add tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:46.107885 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-5696d5d3-0590-4b9a-abad-f1cccb6a8754 req-ee9741e4-dd9a-400c-b51f-a4c29d90d704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a730d46-5e87-4a26-a9fc-4486e99bcf5a", "name": "network-vif-plugged", "status": "completed", "tag": "f2587919-e230-4e3a-8926-a6478337a26a"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:46.116162 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0d36a123-1f9a-4f58-a089-efe450763add tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:46.117608 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-5696d5d3-0590-4b9a-abad-f1cccb6a8754 req-ee9741e4-dd9a-400c-b51f-a4c29d90d704 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:46.117761 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0d36a123-1f9a-4f58-a089-efe450763add tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:46.118060 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-5696d5d3-0590-4b9a-abad-f1cccb6a8754 req-ee9741e4-dd9a-400c-b51f-a4c29d90d704 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:46.118924 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0d36a123-1f9a-4f58-a089-efe450763add tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1720 microversion: 2.20 time: 0.195623 May 10 14:02:46.119847 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 213/451] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:45 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:46.139373 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-5696d5d3-0590-4b9a-abad-f1cccb6a8754 req-ee9741e4-dd9a-400c-b51f-a4c29d90d704 service nova] Creating event network-vif-plugged:f2587919-e230-4e3a-8926-a6478337a26a for instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a on hv-cinder-84067 May 10 14:02:46.144256 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-5696d5d3-0590-4b9a-abad-f1cccb6a8754 req-ee9741e4-dd9a-400c-b51f-a4c29d90d704 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040899 May 10 14:02:46.144847 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 239/452] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:46.162701 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4f786901-82b2-4d93-9007-9dde4185e07c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:46.163276 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4f786901-82b2-4d93-9007-9dde4185e07c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:46.169698 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4f786901-82b2-4d93-9007-9dde4185e07c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:46.170140 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4f786901-82b2-4d93-9007-9dde4185e07c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:46.171094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4f786901-82b2-4d93-9007-9dde4185e07c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:46.171538 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4f786901-82b2-4d93-9007-9dde4185e07c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:46.382677 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4f786901-82b2-4d93-9007-9dde4185e07c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:46.394549 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4f786901-82b2-4d93-9007-9dde4185e07c tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1370 microversion: 2.1 time: 0.235654 May 10 14:02:46.397183 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 214/453] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:46 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:46.467654 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-963c6ea9-351d-479e-a005-78c04eed0720 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:46.468750 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-963c6ea9-351d-479e-a005-78c04eed0720 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:46.475488 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-963c6ea9-351d-479e-a005-78c04eed0720 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:46.476283 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-963c6ea9-351d-479e-a005-78c04eed0720 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:46.477138 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-963c6ea9-351d-479e-a005-78c04eed0720 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:46.477798 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-963c6ea9-351d-479e-a005-78c04eed0720 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:46.729647 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-79957d85-d309-48fb-b0cf-96acb573e15d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:46.730878 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-79957d85-d309-48fb-b0cf-96acb573e15d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:46.736923 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-79957d85-d309-48fb-b0cf-96acb573e15d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:46.737463 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-79957d85-d309-48fb-b0cf-96acb573e15d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:46.738307 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-79957d85-d309-48fb-b0cf-96acb573e15d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:46.738810 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-79957d85-d309-48fb-b0cf-96acb573e15d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:46.751768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-963c6ea9-351d-479e-a005-78c04eed0720 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:46.761590 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-963c6ea9-351d-479e-a005-78c04eed0720 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.299050 May 10 14:02:46.762173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 240/454] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:46 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:47.137548 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f9f9ba8d-ea6e-4fa3-a547-2a97a449b5f6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:47.138158 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f9f9ba8d-ea6e-4fa3-a547-2a97a449b5f6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:47.143892 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f9f9ba8d-ea6e-4fa3-a547-2a97a449b5f6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:47.144373 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f9f9ba8d-ea6e-4fa3-a547-2a97a449b5f6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:47.145145 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f9f9ba8d-ea6e-4fa3-a547-2a97a449b5f6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:47.145581 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f9f9ba8d-ea6e-4fa3-a547-2a97a449b5f6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:47.335617 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f9f9ba8d-ea6e-4fa3-a547-2a97a449b5f6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:47.343277 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f9f9ba8d-ea6e-4fa3-a547-2a97a449b5f6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:47.344805 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f9f9ba8d-ea6e-4fa3-a547-2a97a449b5f6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:47.345985 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f9f9ba8d-ea6e-4fa3-a547-2a97a449b5f6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1720 microversion: 2.20 time: 0.212943 May 10 14:02:47.346753 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 241/455] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:47 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1720 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:02:47.414219 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2ee5ffca-b432-4829-ba44-f77d302ac0f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:47.414861 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2ee5ffca-b432-4829-ba44-f77d302ac0f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:47.420905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ee5ffca-b432-4829-ba44-f77d302ac0f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:47.421355 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ee5ffca-b432-4829-ba44-f77d302ac0f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:47.422152 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ee5ffca-b432-4829-ba44-f77d302ac0f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:47.422590 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ee5ffca-b432-4829-ba44-f77d302ac0f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:47.631706 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2ee5ffca-b432-4829-ba44-f77d302ac0f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:47.641511 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2ee5ffca-b432-4829-ba44-f77d302ac0f4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1370 microversion: 2.1 time: 0.231417 May 10 14:02:47.643520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 242/456] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:47 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:47.696834 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-79957d85-d309-48fb-b0cf-96acb573e15d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "POST /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.971387 May 10 14:02:47.702148 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 215/457] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:02:46 2022] POST /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/os-volume_attachments => generated 194 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:02:47.778894 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-62abfa1d-4e61-414d-9ec3-e8a3cac7e5a4 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:47.779548 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-62abfa1d-4e61-414d-9ec3-e8a3cac7e5a4 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:47.785466 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-62abfa1d-4e61-414d-9ec3-e8a3cac7e5a4 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:47.785919 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-62abfa1d-4e61-414d-9ec3-e8a3cac7e5a4 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:47.786686 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-62abfa1d-4e61-414d-9ec3-e8a3cac7e5a4 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:47.787123 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-62abfa1d-4e61-414d-9ec3-e8a3cac7e5a4 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.006613 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-62abfa1d-4e61-414d-9ec3-e8a3cac7e5a4 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:48.022362 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-62abfa1d-4e61-414d-9ec3-e8a3cac7e5a4 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1700 microversion: 2.1 time: 0.246354 May 10 14:02:48.035850 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 243/458] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:47 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1700 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:48.041771 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fc88456f-df3e-4303-b07b-4aacfb844444 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:48.048996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fc88456f-df3e-4303-b07b-4aacfb844444 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.049483 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fc88456f-df3e-4303-b07b-4aacfb844444 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.078899 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fc88456f-df3e-4303-b07b-4aacfb844444 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Going to try to start instance {{(pid=117153) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 14:02:48.121081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fc88456f-df3e-4303-b07b-4aacfb844444 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "POST /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/action" status: 202 len: 0 microversion: 2.1 time: 0.083907 May 10 14:02:48.121687 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 216/459] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:02:48 2022] POST /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:02:48.129753 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c8f814a9-e425-44d7-84ca-47f7d249d90e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:48.130459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c8f814a9-e425-44d7-84ca-47f7d249d90e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:48.137175 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8f814a9-e425-44d7-84ca-47f7d249d90e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.137619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8f814a9-e425-44d7-84ca-47f7d249d90e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.138381 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8f814a9-e425-44d7-84ca-47f7d249d90e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.138809 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8f814a9-e425-44d7-84ca-47f7d249d90e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.331839 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c8f814a9-e425-44d7-84ca-47f7d249d90e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:48.339868 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c8f814a9-e425-44d7-84ca-47f7d249d90e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1709 microversion: 2.1 time: 0.214018 May 10 14:02:48.340630 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 244/460] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:48 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1709 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:48.367100 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f90f8b75-ebb6-4f18-88f8-9759b50c0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:48.368022 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f90f8b75-ebb6-4f18-88f8-9759b50c0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:48.379387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-e52bd4ae-7123-4082-9ae3-0227efcf79d5 req-d3b1bf9e-cf14-4c79-96f7-fdcf0c0ae9fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2288a3f8-70db-4951-acaf-f839a42ed73b", "tag": "ec56af2f-6e36-458b-8cbf-61f578a6cae0"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:48.386162 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f90f8b75-ebb6-4f18-88f8-9759b50c0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.386531 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f90f8b75-ebb6-4f18-88f8-9759b50c0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.387531 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f90f8b75-ebb6-4f18-88f8-9759b50c0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.388054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f90f8b75-ebb6-4f18-88f8-9759b50c0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.388634 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-e52bd4ae-7123-4082-9ae3-0227efcf79d5 req-d3b1bf9e-cf14-4c79-96f7-fdcf0c0ae9fc service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.393598 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-e52bd4ae-7123-4082-9ae3-0227efcf79d5 req-d3b1bf9e-cf14-4c79-96f7-fdcf0c0ae9fc service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.415073 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-e52bd4ae-7123-4082-9ae3-0227efcf79d5 req-d3b1bf9e-cf14-4c79-96f7-fdcf0c0ae9fc service nova] Creating event network-changed:ec56af2f-6e36-458b-8cbf-61f578a6cae0 for instance 2288a3f8-70db-4951-acaf-f839a42ed73b on hv-cinder-84067 May 10 14:02:48.420063 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-e52bd4ae-7123-4082-9ae3-0227efcf79d5 req-d3b1bf9e-cf14-4c79-96f7-fdcf0c0ae9fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044350 May 10 14:02:48.421237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 245/461] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:48.521359 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f90f8b75-ebb6-4f18-88f8-9759b50c0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:48.529596 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f90f8b75-ebb6-4f18-88f8-9759b50c0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:48.531099 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f90f8b75-ebb6-4f18-88f8-9759b50c0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:48.532297 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f90f8b75-ebb6-4f18-88f8-9759b50c0740 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1720 microversion: 2.20 time: 0.171335 May 10 14:02:48.532863 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 217/462] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:48 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:48.659573 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a5dbb734-191d-4570-b088-4bd6f2dd3dd9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:48.661055 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a5dbb734-191d-4570-b088-4bd6f2dd3dd9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:48.668304 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a5dbb734-191d-4570-b088-4bd6f2dd3dd9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.668767 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a5dbb734-191d-4570-b088-4bd6f2dd3dd9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.669552 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a5dbb734-191d-4570-b088-4bd6f2dd3dd9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.669991 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a5dbb734-191d-4570-b088-4bd6f2dd3dd9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.798157 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a5dbb734-191d-4570-b088-4bd6f2dd3dd9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:48.805907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a5dbb734-191d-4570-b088-4bd6f2dd3dd9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1563 microversion: 2.1 time: 0.150632 May 10 14:02:48.806848 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 246/463] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:48 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:48.823078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f4679331-4c1b-40c2-868c-49063476e457 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:48.823710 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f4679331-4c1b-40c2-868c-49063476e457 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:48.830243 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f4679331-4c1b-40c2-868c-49063476e457 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.830851 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f4679331-4c1b-40c2-868c-49063476e457 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.831754 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f4679331-4c1b-40c2-868c-49063476e457 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.832336 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f4679331-4c1b-40c2-868c-49063476e457 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.913801 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f4679331-4c1b-40c2-868c-49063476e457 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094469 May 10 14:02:48.914513 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 218/464] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 14:02:48 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:49.358095 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e442ff99-03d6-4abc-9f82-ef4d92e695db tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:49.358712 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e442ff99-03d6-4abc-9f82-ef4d92e695db tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:49.365528 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e442ff99-03d6-4abc-9f82-ef4d92e695db tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:49.365989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e442ff99-03d6-4abc-9f82-ef4d92e695db tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:49.366948 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e442ff99-03d6-4abc-9f82-ef4d92e695db tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:49.367544 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e442ff99-03d6-4abc-9f82-ef4d92e695db tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:49.504864 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e442ff99-03d6-4abc-9f82-ef4d92e695db tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:49.514038 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e442ff99-03d6-4abc-9f82-ef4d92e695db tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1709 microversion: 2.1 time: 0.159758 May 10 14:02:49.514615 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 247/465] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:49 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:49.551436 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0aa7315c-dfdc-4a85-8eb6-485201b690d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:49.552054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0aa7315c-dfdc-4a85-8eb6-485201b690d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:49.558983 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0aa7315c-dfdc-4a85-8eb6-485201b690d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:49.559431 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0aa7315c-dfdc-4a85-8eb6-485201b690d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:49.560245 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0aa7315c-dfdc-4a85-8eb6-485201b690d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:49.560684 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0aa7315c-dfdc-4a85-8eb6-485201b690d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:49.821204 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0aa7315c-dfdc-4a85-8eb6-485201b690d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:49.829363 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0aa7315c-dfdc-4a85-8eb6-485201b690d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:49.831054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0aa7315c-dfdc-4a85-8eb6-485201b690d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:49.832710 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0aa7315c-dfdc-4a85-8eb6-485201b690d7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1720 microversion: 2.20 time: 0.285240 May 10 14:02:49.833560 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 219/466] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:49 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1720 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:49.916748 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-1e49513d-5d62-4824-97e1-22e6b64c67ae req-4ee811f3-f608-45e7-84d7-4d56e1251ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067bd8aa-a9d7-41f4-82a3-54e00fe64f68", "name": "network-vif-unplugged", "status": "completed", "tag": "0b32a17e-9e2f-475d-abe1-8b69acb4c76a"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:49.926438 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-1e49513d-5d62-4824-97e1-22e6b64c67ae req-4ee811f3-f608-45e7-84d7-4d56e1251ae7 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:49.927181 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-1e49513d-5d62-4824-97e1-22e6b64c67ae req-4ee811f3-f608-45e7-84d7-4d56e1251ae7 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:49.940077 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-1e49513d-5d62-4824-97e1-22e6b64c67ae req-4ee811f3-f608-45e7-84d7-4d56e1251ae7 service nova] Creating event network-vif-unplugged:0b32a17e-9e2f-475d-abe1-8b69acb4c76a for instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 on hv-cinder-84067 May 10 14:02:49.945217 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-1e49513d-5d62-4824-97e1-22e6b64c67ae req-4ee811f3-f608-45e7-84d7-4d56e1251ae7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032692 May 10 14:02:49.946120 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 248/467] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:50.211890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-2f8252d2-fe72-490c-b856-561bf09e5f50 req-97f25b71-0192-4c69-adb4-3a2671036566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a730d46-5e87-4a26-a9fc-4486e99bcf5a", "tag": "f2587919-e230-4e3a-8926-a6478337a26a"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:50.219868 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-2f8252d2-fe72-490c-b856-561bf09e5f50 req-97f25b71-0192-4c69-adb4-3a2671036566 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:50.220425 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-2f8252d2-fe72-490c-b856-561bf09e5f50 req-97f25b71-0192-4c69-adb4-3a2671036566 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:50.230894 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-2f8252d2-fe72-490c-b856-561bf09e5f50 req-97f25b71-0192-4c69-adb4-3a2671036566 service nova] Creating event network-changed:f2587919-e230-4e3a-8926-a6478337a26a for instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a on hv-cinder-84067 May 10 14:02:50.235669 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-2f8252d2-fe72-490c-b856-561bf09e5f50 req-97f25b71-0192-4c69-adb4-3a2671036566 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027470 May 10 14:02:50.236278 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 220/468] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:50.532482 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1b2a1fd3-1596-453a-ac5b-026944f7590e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:50.533285 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1b2a1fd3-1596-453a-ac5b-026944f7590e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:50.540319 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1b2a1fd3-1596-453a-ac5b-026944f7590e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:50.540856 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1b2a1fd3-1596-453a-ac5b-026944f7590e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:50.541746 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1b2a1fd3-1596-453a-ac5b-026944f7590e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:50.542243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1b2a1fd3-1596-453a-ac5b-026944f7590e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:50.835436 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1b2a1fd3-1596-453a-ac5b-026944f7590e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:50.851995 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-87931f86-fcc2-46f7-8dcc-6432f3884fe5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:50.852663 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-87931f86-fcc2-46f7-8dcc-6432f3884fe5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:50.862969 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1b2a1fd3-1596-453a-ac5b-026944f7590e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1709 microversion: 2.1 time: 0.334599 May 10 14:02:50.865057 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-87931f86-fcc2-46f7-8dcc-6432f3884fe5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:50.865763 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-87931f86-fcc2-46f7-8dcc-6432f3884fe5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:50.870346 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-87931f86-fcc2-46f7-8dcc-6432f3884fe5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:50.871053 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-87931f86-fcc2-46f7-8dcc-6432f3884fe5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:50.879624 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 249/469] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:50 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1709 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:51.024967 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-87931f86-fcc2-46f7-8dcc-6432f3884fe5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:51.032722 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-87931f86-fcc2-46f7-8dcc-6432f3884fe5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:51.034221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-87931f86-fcc2-46f7-8dcc-6432f3884fe5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:51.035365 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-87931f86-fcc2-46f7-8dcc-6432f3884fe5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1723 microversion: 2.20 time: 0.188174 May 10 14:02:51.035930 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 221/470] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:50 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:02:51.053377 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-03a36c39-f15b-475b-b6be-f7623ccaf738 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b74c00c0-0f79-42d0-b621-ec754f20297d"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:51.054434 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-03a36c39-f15b-475b-b6be-f7623ccaf738 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:51.060426 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-03a36c39-f15b-475b-b6be-f7623ccaf738 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:51.060882 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-03a36c39-f15b-475b-b6be-f7623ccaf738 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:51.061703 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-03a36c39-f15b-475b-b6be-f7623ccaf738 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:51.062095 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-03a36c39-f15b-475b-b6be-f7623ccaf738 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:51.446836 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-03a36c39-f15b-475b-b6be-f7623ccaf738 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "POST /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.396139 May 10 14:02:51.452081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 250/471] 10.222.0.49 () {62 vars in 1363 bytes} [Tue May 10 14:02:51 2022] POST /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/os-volume_attachments => generated 188 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:02:51.623072 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-db208d13-3414-419d-8ab1-e47e7f45dc8c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:51.624027 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-db208d13-3414-419d-8ab1-e47e7f45dc8c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:51.635475 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-db208d13-3414-419d-8ab1-e47e7f45dc8c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:51.638313 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-db208d13-3414-419d-8ab1-e47e7f45dc8c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:51.639253 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-db208d13-3414-419d-8ab1-e47e7f45dc8c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:51.639903 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-db208d13-3414-419d-8ab1-e47e7f45dc8c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:51.835772 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-db208d13-3414-419d-8ab1-e47e7f45dc8c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "POST /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/action" status: 202 len: 0 microversion: 2.20 time: 0.216960 May 10 14:02:51.837776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 222/472] 10.222.0.49 () {62 vars in 1318 bytes} [Tue May 10 14:02:51 2022] POST /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 14:02:51.846439 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ed3df2f2-4251-4603-8f84-34a1d99bdb7e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:51.851789 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ed3df2f2-4251-4603-8f84-34a1d99bdb7e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:51.866516 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ed3df2f2-4251-4603-8f84-34a1d99bdb7e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:51.867120 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ed3df2f2-4251-4603-8f84-34a1d99bdb7e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:51.868096 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ed3df2f2-4251-4603-8f84-34a1d99bdb7e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:51.868622 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ed3df2f2-4251-4603-8f84-34a1d99bdb7e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:51.886831 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-48f2c900-da9d-42a0-baa1-48a1630f6c21 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:51.887612 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-48f2c900-da9d-42a0-baa1-48a1630f6c21 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:51.904282 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-48f2c900-da9d-42a0-baa1-48a1630f6c21 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:51.904897 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-48f2c900-da9d-42a0-baa1-48a1630f6c21 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:51.905794 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-48f2c900-da9d-42a0-baa1-48a1630f6c21 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:51.911629 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-48f2c900-da9d-42a0-baa1-48a1630f6c21 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:52.171276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ed3df2f2-4251-4603-8f84-34a1d99bdb7e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:52.181691 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ed3df2f2-4251-4603-8f84-34a1d99bdb7e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:52.183681 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ed3df2f2-4251-4603-8f84-34a1d99bdb7e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:52.185449 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ed3df2f2-4251-4603-8f84-34a1d99bdb7e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1749 microversion: 2.20 time: 0.342963 May 10 14:02:52.186603 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 251/473] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:51 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1749 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:52.255141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-48f2c900-da9d-42a0-baa1-48a1630f6c21 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:52.264921 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-48f2c900-da9d-42a0-baa1-48a1630f6c21 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1709 microversion: 2.1 time: 0.388426 May 10 14:02:52.265498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 223/474] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:51 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1709 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:53.204464 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9ca3fb29-e575-4d04-a5e2-935d43efe661 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:53.205098 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9ca3fb29-e575-4d04-a5e2-935d43efe661 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:53.211775 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9ca3fb29-e575-4d04-a5e2-935d43efe661 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:53.212314 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9ca3fb29-e575-4d04-a5e2-935d43efe661 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:53.213080 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9ca3fb29-e575-4d04-a5e2-935d43efe661 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:53.213514 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9ca3fb29-e575-4d04-a5e2-935d43efe661 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:53.283887 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0eb40606-fc41-44a9-bfa3-5f939b0ed5d7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:53.284544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0eb40606-fc41-44a9-bfa3-5f939b0ed5d7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:53.294255 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0eb40606-fc41-44a9-bfa3-5f939b0ed5d7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:53.294718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0eb40606-fc41-44a9-bfa3-5f939b0ed5d7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:53.295679 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0eb40606-fc41-44a9-bfa3-5f939b0ed5d7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:53.296127 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0eb40606-fc41-44a9-bfa3-5f939b0ed5d7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:53.442076 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0eb40606-fc41-44a9-bfa3-5f939b0ed5d7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:53.452066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0eb40606-fc41-44a9-bfa3-5f939b0ed5d7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1709 microversion: 2.1 time: 0.173384 May 10 14:02:53.462284 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 224/475] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:53 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1709 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:53.604726 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9ca3fb29-e575-4d04-a5e2-935d43efe661 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:53.618061 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9ca3fb29-e575-4d04-a5e2-935d43efe661 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:53.619677 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9ca3fb29-e575-4d04-a5e2-935d43efe661 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:53.620957 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9ca3fb29-e575-4d04-a5e2-935d43efe661 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1749 microversion: 2.20 time: 0.420397 May 10 14:02:53.621637 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 252/476] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:53 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1749 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:54.469893 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0a0b5688-8c4d-4792-8a3d-cd9af3f30db2 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:54.470509 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0a0b5688-8c4d-4792-8a3d-cd9af3f30db2 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:54.476893 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0a0b5688-8c4d-4792-8a3d-cd9af3f30db2 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:54.477339 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0a0b5688-8c4d-4792-8a3d-cd9af3f30db2 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:54.478108 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0a0b5688-8c4d-4792-8a3d-cd9af3f30db2 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:54.478549 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0a0b5688-8c4d-4792-8a3d-cd9af3f30db2 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:54.601591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0a0b5688-8c4d-4792-8a3d-cd9af3f30db2 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:54.610298 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0a0b5688-8c4d-4792-8a3d-cd9af3f30db2 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1713 microversion: 2.1 time: 0.144251 May 10 14:02:54.610990 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 225/477] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:54 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1713 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:54.639722 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-36d52a6f-8c7d-4377-a81f-9ac03f5f3a2d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:54.640357 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-36d52a6f-8c7d-4377-a81f-9ac03f5f3a2d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:54.647580 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-36d52a6f-8c7d-4377-a81f-9ac03f5f3a2d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:54.648026 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-36d52a6f-8c7d-4377-a81f-9ac03f5f3a2d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:54.648812 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-36d52a6f-8c7d-4377-a81f-9ac03f5f3a2d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:54.649249 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-36d52a6f-8c7d-4377-a81f-9ac03f5f3a2d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:54.773058 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-36d52a6f-8c7d-4377-a81f-9ac03f5f3a2d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:54.781120 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-36d52a6f-8c7d-4377-a81f-9ac03f5f3a2d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:54.782611 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-36d52a6f-8c7d-4377-a81f-9ac03f5f3a2d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:54.783756 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-36d52a6f-8c7d-4377-a81f-9ac03f5f3a2d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1751 microversion: 2.20 time: 0.147964 May 10 14:02:54.784363 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 253/478] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:54 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1751 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:55.802376 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d40294f5-b71b-4c8e-a6ca-c44e58796da6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:55.803502 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d40294f5-b71b-4c8e-a6ca-c44e58796da6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:55.809866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d40294f5-b71b-4c8e-a6ca-c44e58796da6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:55.810315 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d40294f5-b71b-4c8e-a6ca-c44e58796da6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:55.811081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d40294f5-b71b-4c8e-a6ca-c44e58796da6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:55.811517 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d40294f5-b71b-4c8e-a6ca-c44e58796da6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:55.941466 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d40294f5-b71b-4c8e-a6ca-c44e58796da6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:55.949702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d40294f5-b71b-4c8e-a6ca-c44e58796da6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:55.951199 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d40294f5-b71b-4c8e-a6ca-c44e58796da6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:55.952376 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d40294f5-b71b-4c8e-a6ca-c44e58796da6 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1751 microversion: 2.20 time: 0.153977 May 10 14:02:55.952961 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 226/479] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:55 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:56.970778 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e5c03d59-a973-44b8-bbce-dbad1b959d5b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:56.971387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e5c03d59-a973-44b8-bbce-dbad1b959d5b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:56.978284 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5c03d59-a973-44b8-bbce-dbad1b959d5b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:56.978736 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5c03d59-a973-44b8-bbce-dbad1b959d5b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:56.979499 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5c03d59-a973-44b8-bbce-dbad1b959d5b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:56.979935 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5c03d59-a973-44b8-bbce-dbad1b959d5b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:57.107544 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e5c03d59-a973-44b8-bbce-dbad1b959d5b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:57.115760 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e5c03d59-a973-44b8-bbce-dbad1b959d5b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:57.117373 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e5c03d59-a973-44b8-bbce-dbad1b959d5b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:57.118804 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e5c03d59-a973-44b8-bbce-dbad1b959d5b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1751 microversion: 2.20 time: 0.151628 May 10 14:02:57.119375 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 254/480] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:56 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:58.136896 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3dd6a20f-cd64-4743-8d7a-cbf3d8ce541a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:58.137496 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-3dd6a20f-cd64-4743-8d7a-cbf3d8ce541a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:58.143741 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3dd6a20f-cd64-4743-8d7a-cbf3d8ce541a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:58.144217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3dd6a20f-cd64-4743-8d7a-cbf3d8ce541a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:58.144994 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3dd6a20f-cd64-4743-8d7a-cbf3d8ce541a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:58.145436 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3dd6a20f-cd64-4743-8d7a-cbf3d8ce541a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:58.517812 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ad5c55ee-6bdf-4451-ab59-5139b34784a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:58.518617 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ad5c55ee-6bdf-4451-ab59-5139b34784a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:58.526217 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ad5c55ee-6bdf-4451-ab59-5139b34784a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:58.526903 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ad5c55ee-6bdf-4451-ab59-5139b34784a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:58.527715 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ad5c55ee-6bdf-4451-ab59-5139b34784a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:58.528361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ad5c55ee-6bdf-4451-ab59-5139b34784a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:58.567942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3dd6a20f-cd64-4743-8d7a-cbf3d8ce541a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:58.576873 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3dd6a20f-cd64-4743-8d7a-cbf3d8ce541a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:58.578553 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3dd6a20f-cd64-4743-8d7a-cbf3d8ce541a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:58.579802 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3dd6a20f-cd64-4743-8d7a-cbf3d8ce541a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1751 microversion: 2.20 time: 0.446817 May 10 14:02:58.580392 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 227/481] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:58 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1751 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:02:58.663638 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ad5c55ee-6bdf-4451-ab59-5139b34784a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:58.671766 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ad5c55ee-6bdf-4451-ab59-5139b34784a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1594 microversion: 2.1 time: 0.157648 May 10 14:02:58.672429 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 255/482] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:02:58 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:59.598029 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f79362a4-7481-4152-b0d7-87965eae6389 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:59.599402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f79362a4-7481-4152-b0d7-87965eae6389 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:59.606117 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f79362a4-7481-4152-b0d7-87965eae6389 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:59.606753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f79362a4-7481-4152-b0d7-87965eae6389 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:59.607542 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f79362a4-7481-4152-b0d7-87965eae6389 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:59.607979 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f79362a4-7481-4152-b0d7-87965eae6389 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:59.817881 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f79362a4-7481-4152-b0d7-87965eae6389 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:59.827298 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f79362a4-7481-4152-b0d7-87965eae6389 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:59.828939 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f79362a4-7481-4152-b0d7-87965eae6389 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:59.830214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f79362a4-7481-4152-b0d7-87965eae6389 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.236151 May 10 14:02:59.830974 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 228/483] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:02:59 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:00.406553 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-0c65d1ac-f689-4ebd-ae90-9664c7792e65 req-8bdeb407-8790-4e38-8998-6fec7652c744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8821a821-144b-4a72-b16e-07014a8063d0", "tag": "12100075-8151-4b48-9d14-6864846987d2"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:00.417186 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-0c65d1ac-f689-4ebd-ae90-9664c7792e65 req-8bdeb407-8790-4e38-8998-6fec7652c744 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:00.417634 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-0c65d1ac-f689-4ebd-ae90-9664c7792e65 req-8bdeb407-8790-4e38-8998-6fec7652c744 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:00.429733 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-0c65d1ac-f689-4ebd-ae90-9664c7792e65 req-8bdeb407-8790-4e38-8998-6fec7652c744 service nova] Creating event network-changed:12100075-8151-4b48-9d14-6864846987d2 for instance 8821a821-144b-4a72-b16e-07014a8063d0 on hv-cinder-84067 May 10 14:03:00.434720 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-0c65d1ac-f689-4ebd-ae90-9664c7792e65 req-8bdeb407-8790-4e38-8998-6fec7652c744 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032150 May 10 14:03:00.435462 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 256/484] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:00.861314 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b0234ad5-e116-432c-b1c7-2a88fcfa1ed3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:00.862074 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b0234ad5-e116-432c-b1c7-2a88fcfa1ed3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:00.878353 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b0234ad5-e116-432c-b1c7-2a88fcfa1ed3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:00.878802 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b0234ad5-e116-432c-b1c7-2a88fcfa1ed3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:00.879659 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b0234ad5-e116-432c-b1c7-2a88fcfa1ed3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:00.889080 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b0234ad5-e116-432c-b1c7-2a88fcfa1ed3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:01.263761 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b0234ad5-e116-432c-b1c7-2a88fcfa1ed3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:01.297415 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b0234ad5-e116-432c-b1c7-2a88fcfa1ed3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:01.304909 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b0234ad5-e116-432c-b1c7-2a88fcfa1ed3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:01.308705 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b0234ad5-e116-432c-b1c7-2a88fcfa1ed3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.461550 May 10 14:03:01.312845 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 229/485] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:00 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:01.690189 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-05977c4a-ecfc-4398-8250-44621a512c0f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1655833722"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:01.691033 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-05977c4a-ecfc-4398-8250-44621a512c0f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:01.697702 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-05977c4a-ecfc-4398-8250-44621a512c0f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:01.698158 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-05977c4a-ecfc-4398-8250-44621a512c0f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:01.699099 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-05977c4a-ecfc-4398-8250-44621a512c0f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:01.699567 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-05977c4a-ecfc-4398-8250-44621a512c0f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:01.845453 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.network.security_group_api [None req-05977c4a-ecfc-4398-8250-44621a512c0f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Adding security group b68aabd1-8ee1-4921-b3d2-67aaf1765d25 to port 12100075-8151-4b48-9d14-6864846987d2 May 10 14:03:02.226048 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-05977c4a-ecfc-4398-8250-44621a512c0f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "POST /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/action" status: 202 len: 0 microversion: 2.1 time: 0.544033 May 10 14:03:02.233744 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 257/486] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:03:01 2022] POST /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:03:02.236985 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-03cc11f4-a259-4973-9e57-e26c5d03f4c5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:02.237775 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-03cc11f4-a259-4973-9e57-e26c5d03f4c5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:02.244592 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-03cc11f4-a259-4973-9e57-e26c5d03f4c5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:02.245280 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-03cc11f4-a259-4973-9e57-e26c5d03f4c5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:02.246221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-03cc11f4-a259-4973-9e57-e26c5d03f4c5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:02.246827 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-03cc11f4-a259-4973-9e57-e26c5d03f4c5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:02.330817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3d7c5da4-836c-4e51-aaa0-8e243b3aaa4d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:02.331446 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3d7c5da4-836c-4e51-aaa0-8e243b3aaa4d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:02.341583 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d7c5da4-836c-4e51-aaa0-8e243b3aaa4d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:02.341951 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d7c5da4-836c-4e51-aaa0-8e243b3aaa4d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:02.342737 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d7c5da4-836c-4e51-aaa0-8e243b3aaa4d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:02.343182 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d7c5da4-836c-4e51-aaa0-8e243b3aaa4d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:02.501289 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-03cc11f4-a259-4973-9e57-e26c5d03f4c5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:02.511886 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-03cc11f4-a259-4973-9e57-e26c5d03f4c5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1641 microversion: 2.1 time: 0.280368 May 10 14:03:02.515291 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 230/487] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:02 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1641 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:02.520450 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-f0ce8ecc-e6f8-4ac4-b426-7a7a35b8b4af req-98c37578-fc91-4932-9e2d-a367816fdeec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8821a821-144b-4a72-b16e-07014a8063d0", "tag": "12100075-8151-4b48-9d14-6864846987d2"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:02.539995 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-f0ce8ecc-e6f8-4ac4-b426-7a7a35b8b4af req-98c37578-fc91-4932-9e2d-a367816fdeec service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:02.540548 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-f0ce8ecc-e6f8-4ac4-b426-7a7a35b8b4af req-98c37578-fc91-4932-9e2d-a367816fdeec service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:02.560009 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-f0ce8ecc-e6f8-4ac4-b426-7a7a35b8b4af req-98c37578-fc91-4932-9e2d-a367816fdeec service nova] Creating event network-changed:12100075-8151-4b48-9d14-6864846987d2 for instance 8821a821-144b-4a72-b16e-07014a8063d0 on hv-cinder-84067 May 10 14:03:02.567963 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-f0ce8ecc-e6f8-4ac4-b426-7a7a35b8b4af req-98c37578-fc91-4932-9e2d-a367816fdeec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050651 May 10 14:03:02.570059 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 231/488] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:02.620319 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3d7c5da4-836c-4e51-aaa0-8e243b3aaa4d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:02.629782 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3d7c5da4-836c-4e51-aaa0-8e243b3aaa4d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:02.631370 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3d7c5da4-836c-4e51-aaa0-8e243b3aaa4d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:02.633041 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3d7c5da4-836c-4e51-aaa0-8e243b3aaa4d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.306744 May 10 14:03:02.633606 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 258/489] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:02 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:03.654782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bcad40f2-0169-4db6-814c-8e9ca7bcaf64 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:03.655409 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bcad40f2-0169-4db6-814c-8e9ca7bcaf64 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:03.661714 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bcad40f2-0169-4db6-814c-8e9ca7bcaf64 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:03.662167 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bcad40f2-0169-4db6-814c-8e9ca7bcaf64 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:03.662951 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bcad40f2-0169-4db6-814c-8e9ca7bcaf64 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:03.663393 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bcad40f2-0169-4db6-814c-8e9ca7bcaf64 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:03.799854 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bcad40f2-0169-4db6-814c-8e9ca7bcaf64 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:03.809257 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bcad40f2-0169-4db6-814c-8e9ca7bcaf64 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:03.810768 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bcad40f2-0169-4db6-814c-8e9ca7bcaf64 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:03.811936 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bcad40f2-0169-4db6-814c-8e9ca7bcaf64 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.164586 May 10 14:03:03.812846 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 232/490] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:03 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:04.830868 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-74069a10-9ac2-4585-9a2b-f5054aa5635f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:04.832334 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-74069a10-9ac2-4585-9a2b-f5054aa5635f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:04.839578 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-74069a10-9ac2-4585-9a2b-f5054aa5635f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:04.840120 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-74069a10-9ac2-4585-9a2b-f5054aa5635f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:04.840999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-74069a10-9ac2-4585-9a2b-f5054aa5635f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:04.841524 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-74069a10-9ac2-4585-9a2b-f5054aa5635f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:04.976531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-74069a10-9ac2-4585-9a2b-f5054aa5635f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:04.984952 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-74069a10-9ac2-4585-9a2b-f5054aa5635f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:04.986493 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-74069a10-9ac2-4585-9a2b-f5054aa5635f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:04.987639 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-74069a10-9ac2-4585-9a2b-f5054aa5635f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.160864 May 10 14:03:04.988427 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 259/491] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:04 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:06.006415 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9bf48b5d-0e26-43c2-a080-c9b05155d5ca tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:06.007620 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9bf48b5d-0e26-43c2-a080-c9b05155d5ca tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:06.014502 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9bf48b5d-0e26-43c2-a080-c9b05155d5ca tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:06.014940 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9bf48b5d-0e26-43c2-a080-c9b05155d5ca tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:06.015724 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9bf48b5d-0e26-43c2-a080-c9b05155d5ca tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:06.016188 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9bf48b5d-0e26-43c2-a080-c9b05155d5ca tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:06.151063 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9bf48b5d-0e26-43c2-a080-c9b05155d5ca tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:06.159654 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9bf48b5d-0e26-43c2-a080-c9b05155d5ca tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:06.164618 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9bf48b5d-0e26-43c2-a080-c9b05155d5ca tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:06.164618 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9bf48b5d-0e26-43c2-a080-c9b05155d5ca tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.160289 May 10 14:03:06.164618 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 233/492] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:06 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:07.185989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-55824f0a-f3bf-4267-88dc-180a5aeee5b5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:07.186700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-55824f0a-f3bf-4267-88dc-180a5aeee5b5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:07.193243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-55824f0a-f3bf-4267-88dc-180a5aeee5b5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:07.193786 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-55824f0a-f3bf-4267-88dc-180a5aeee5b5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:07.195156 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-55824f0a-f3bf-4267-88dc-180a5aeee5b5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:07.195591 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-55824f0a-f3bf-4267-88dc-180a5aeee5b5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:07.330717 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-55824f0a-f3bf-4267-88dc-180a5aeee5b5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:07.339278 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-55824f0a-f3bf-4267-88dc-180a5aeee5b5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:07.340805 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-55824f0a-f3bf-4267-88dc-180a5aeee5b5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:07.341965 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-55824f0a-f3bf-4267-88dc-180a5aeee5b5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.159935 May 10 14:03:07.342717 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 260/493] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:07 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:08.360093 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-da2e0ab8-84fe-4992-a099-71758bcaff79 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:08.360753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-da2e0ab8-84fe-4992-a099-71758bcaff79 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:08.367243 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-da2e0ab8-84fe-4992-a099-71758bcaff79 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:08.367683 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-da2e0ab8-84fe-4992-a099-71758bcaff79 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:08.368479 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-da2e0ab8-84fe-4992-a099-71758bcaff79 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:08.368910 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-da2e0ab8-84fe-4992-a099-71758bcaff79 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:08.505258 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-da2e0ab8-84fe-4992-a099-71758bcaff79 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:08.514759 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-da2e0ab8-84fe-4992-a099-71758bcaff79 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:08.517669 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-da2e0ab8-84fe-4992-a099-71758bcaff79 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:08.518877 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-da2e0ab8-84fe-4992-a099-71758bcaff79 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.162699 May 10 14:03:08.519701 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 234/494] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:08 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:09.538014 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e0a59368-5556-4c82-89e1-8fd293c1f1ac tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:09.538613 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e0a59368-5556-4c82-89e1-8fd293c1f1ac tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:09.545232 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e0a59368-5556-4c82-89e1-8fd293c1f1ac tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:09.545690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e0a59368-5556-4c82-89e1-8fd293c1f1ac tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:09.546476 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e0a59368-5556-4c82-89e1-8fd293c1f1ac tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:09.546915 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e0a59368-5556-4c82-89e1-8fd293c1f1ac tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:09.676779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e0a59368-5556-4c82-89e1-8fd293c1f1ac tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:09.686119 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e0a59368-5556-4c82-89e1-8fd293c1f1ac tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:09.687631 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e0a59368-5556-4c82-89e1-8fd293c1f1ac tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:09.688825 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e0a59368-5556-4c82-89e1-8fd293c1f1ac tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.154770 May 10 14:03:09.689722 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 261/495] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:09 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:03:10.707095 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9fc4a16d-1c6e-4ec6-b6e9-d929f39f8237 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:10.707761 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9fc4a16d-1c6e-4ec6-b6e9-d929f39f8237 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:10.714306 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9fc4a16d-1c6e-4ec6-b6e9-d929f39f8237 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:10.714759 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9fc4a16d-1c6e-4ec6-b6e9-d929f39f8237 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:10.715537 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9fc4a16d-1c6e-4ec6-b6e9-d929f39f8237 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:10.715976 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9fc4a16d-1c6e-4ec6-b6e9-d929f39f8237 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:10.849691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9fc4a16d-1c6e-4ec6-b6e9-d929f39f8237 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:10.863041 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9fc4a16d-1c6e-4ec6-b6e9-d929f39f8237 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:10.864622 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9fc4a16d-1c6e-4ec6-b6e9-d929f39f8237 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:10.865971 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9fc4a16d-1c6e-4ec6-b6e9-d929f39f8237 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.162856 May 10 14:03:10.866532 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 235/496] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:10 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:11.885149 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ef08b93b-e4f0-4812-897a-ff371b548e22 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:11.886757 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ef08b93b-e4f0-4812-897a-ff371b548e22 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:11.893354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ef08b93b-e4f0-4812-897a-ff371b548e22 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:11.893889 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ef08b93b-e4f0-4812-897a-ff371b548e22 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:11.894673 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ef08b93b-e4f0-4812-897a-ff371b548e22 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:11.895103 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ef08b93b-e4f0-4812-897a-ff371b548e22 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:12.026548 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ef08b93b-e4f0-4812-897a-ff371b548e22 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:12.035087 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ef08b93b-e4f0-4812-897a-ff371b548e22 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:12.036615 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ef08b93b-e4f0-4812-897a-ff371b548e22 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:12.037761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ef08b93b-e4f0-4812-897a-ff371b548e22 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.157170 May 10 14:03:12.038406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 262/497] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:11 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:03:13.056700 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-214bf8d1-bc35-42cd-b98c-2f492be6bdf3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:13.057329 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-214bf8d1-bc35-42cd-b98c-2f492be6bdf3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:13.063496 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-214bf8d1-bc35-42cd-b98c-2f492be6bdf3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:13.063938 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-214bf8d1-bc35-42cd-b98c-2f492be6bdf3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:13.064730 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-214bf8d1-bc35-42cd-b98c-2f492be6bdf3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:13.065161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-214bf8d1-bc35-42cd-b98c-2f492be6bdf3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:13.214070 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-214bf8d1-bc35-42cd-b98c-2f492be6bdf3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:13.222122 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-214bf8d1-bc35-42cd-b98c-2f492be6bdf3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:13.223607 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-214bf8d1-bc35-42cd-b98c-2f492be6bdf3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:13.224771 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-214bf8d1-bc35-42cd-b98c-2f492be6bdf3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.172588 May 10 14:03:13.225331 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 236/498] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:13 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:14.243328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c84e4dad-4052-4e48-a6de-b191fc727f35 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:14.243982 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c84e4dad-4052-4e48-a6de-b191fc727f35 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:14.250404 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c84e4dad-4052-4e48-a6de-b191fc727f35 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:14.250858 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c84e4dad-4052-4e48-a6de-b191fc727f35 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:14.251636 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c84e4dad-4052-4e48-a6de-b191fc727f35 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:14.252074 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c84e4dad-4052-4e48-a6de-b191fc727f35 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:14.386015 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c84e4dad-4052-4e48-a6de-b191fc727f35 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:14.394401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c84e4dad-4052-4e48-a6de-b191fc727f35 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:14.396189 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c84e4dad-4052-4e48-a6de-b191fc727f35 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:14.397340 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c84e4dad-4052-4e48-a6de-b191fc727f35 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.158518 May 10 14:03:14.398125 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 263/499] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:14 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:03:15.415912 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-404964ef-0e21-46f9-ad48-c978ade714bc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:15.416534 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-404964ef-0e21-46f9-ad48-c978ade714bc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:15.422786 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-404964ef-0e21-46f9-ad48-c978ade714bc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:15.423226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-404964ef-0e21-46f9-ad48-c978ade714bc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:15.423976 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-404964ef-0e21-46f9-ad48-c978ade714bc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:15.424443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-404964ef-0e21-46f9-ad48-c978ade714bc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:15.552978 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-404964ef-0e21-46f9-ad48-c978ade714bc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:15.561562 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-404964ef-0e21-46f9-ad48-c978ade714bc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:15.563050 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-404964ef-0e21-46f9-ad48-c978ade714bc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:15.564207 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-404964ef-0e21-46f9-ad48-c978ade714bc tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.152109 May 10 14:03:15.564759 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 237/500] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:15 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:16.582766 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-01d6aab6-8c52-42fa-9b1f-07342cb2a32b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:16.583372 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-01d6aab6-8c52-42fa-9b1f-07342cb2a32b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:16.590273 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-01d6aab6-8c52-42fa-9b1f-07342cb2a32b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:16.590721 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-01d6aab6-8c52-42fa-9b1f-07342cb2a32b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:16.591486 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-01d6aab6-8c52-42fa-9b1f-07342cb2a32b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:16.591918 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-01d6aab6-8c52-42fa-9b1f-07342cb2a32b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:16.716034 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-01d6aab6-8c52-42fa-9b1f-07342cb2a32b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:16.724116 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-01d6aab6-8c52-42fa-9b1f-07342cb2a32b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:16.725627 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-01d6aab6-8c52-42fa-9b1f-07342cb2a32b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:16.726783 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-01d6aab6-8c52-42fa-9b1f-07342cb2a32b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.147935 May 10 14:03:16.727355 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 264/501] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:16 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:17.744966 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-57e733e2-6a55-423c-94d2-d41553096909 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:17.745528 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-57e733e2-6a55-423c-94d2-d41553096909 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:17.751379 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-57e733e2-6a55-423c-94d2-d41553096909 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:17.751824 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-57e733e2-6a55-423c-94d2-d41553096909 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:17.752631 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-57e733e2-6a55-423c-94d2-d41553096909 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:17.753066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-57e733e2-6a55-423c-94d2-d41553096909 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:17.876397 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-57e733e2-6a55-423c-94d2-d41553096909 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:17.884986 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-57e733e2-6a55-423c-94d2-d41553096909 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:17.886488 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-57e733e2-6a55-423c-94d2-d41553096909 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:17.887632 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-57e733e2-6a55-423c-94d2-d41553096909 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.146813 May 10 14:03:17.888219 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 238/502] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:17 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:18.906255 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-92dc43ad-b361-4757-981c-c7a1e35f1949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:18.906889 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-92dc43ad-b361-4757-981c-c7a1e35f1949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:18.913124 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-92dc43ad-b361-4757-981c-c7a1e35f1949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:18.914067 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-92dc43ad-b361-4757-981c-c7a1e35f1949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:18.914875 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-92dc43ad-b361-4757-981c-c7a1e35f1949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:18.915302 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-92dc43ad-b361-4757-981c-c7a1e35f1949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:19.043086 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-92dc43ad-b361-4757-981c-c7a1e35f1949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:19.051223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-92dc43ad-b361-4757-981c-c7a1e35f1949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:19.052759 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-92dc43ad-b361-4757-981c-c7a1e35f1949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:19.053905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-92dc43ad-b361-4757-981c-c7a1e35f1949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.151479 May 10 14:03:19.054465 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 265/503] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:18 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:20.071589 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-41f8dbe5-2487-461a-8b25-473ae5713a8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:20.072202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-41f8dbe5-2487-461a-8b25-473ae5713a8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:20.078436 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-41f8dbe5-2487-461a-8b25-473ae5713a8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:20.078953 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-41f8dbe5-2487-461a-8b25-473ae5713a8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:20.079713 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-41f8dbe5-2487-461a-8b25-473ae5713a8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:20.080141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-41f8dbe5-2487-461a-8b25-473ae5713a8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:20.206595 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-41f8dbe5-2487-461a-8b25-473ae5713a8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:20.215380 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-41f8dbe5-2487-461a-8b25-473ae5713a8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:20.216895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-41f8dbe5-2487-461a-8b25-473ae5713a8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:20.218034 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-41f8dbe5-2487-461a-8b25-473ae5713a8a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.150356 May 10 14:03:20.218592 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 239/504] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:20 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:21.235879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-63a3917c-79de-48e4-8f62-4f752b1ac385 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:21.236544 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-63a3917c-79de-48e4-8f62-4f752b1ac385 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:21.243347 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-63a3917c-79de-48e4-8f62-4f752b1ac385 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:21.243788 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-63a3917c-79de-48e4-8f62-4f752b1ac385 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:21.244568 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-63a3917c-79de-48e4-8f62-4f752b1ac385 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:21.244999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-63a3917c-79de-48e4-8f62-4f752b1ac385 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:21.368669 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-63a3917c-79de-48e4-8f62-4f752b1ac385 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:21.376721 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-63a3917c-79de-48e4-8f62-4f752b1ac385 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:21.378211 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-63a3917c-79de-48e4-8f62-4f752b1ac385 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:21.379353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-63a3917c-79de-48e4-8f62-4f752b1ac385 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.147383 May 10 14:03:21.379916 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 266/505] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:21 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:22.397718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-06f63e0b-ea40-4201-8c83-11266b308687 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:22.398328 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-06f63e0b-ea40-4201-8c83-11266b308687 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:22.404693 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-06f63e0b-ea40-4201-8c83-11266b308687 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:22.405136 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-06f63e0b-ea40-4201-8c83-11266b308687 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:22.405899 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-06f63e0b-ea40-4201-8c83-11266b308687 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:22.406331 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-06f63e0b-ea40-4201-8c83-11266b308687 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:22.532584 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-06f63e0b-ea40-4201-8c83-11266b308687 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:22.541135 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-06f63e0b-ea40-4201-8c83-11266b308687 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:22.542617 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-06f63e0b-ea40-4201-8c83-11266b308687 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:22.543753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-06f63e0b-ea40-4201-8c83-11266b308687 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.150410 May 10 14:03:22.544334 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 240/506] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:22 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:23.562214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-63f42d30-0302-412b-ad4e-970e389435c3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:23.562819 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-63f42d30-0302-412b-ad4e-970e389435c3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:23.569115 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-63f42d30-0302-412b-ad4e-970e389435c3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:23.570130 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-63f42d30-0302-412b-ad4e-970e389435c3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:23.570886 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-63f42d30-0302-412b-ad4e-970e389435c3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:23.571319 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-63f42d30-0302-412b-ad4e-970e389435c3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:23.695975 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-63f42d30-0302-412b-ad4e-970e389435c3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:23.704099 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-63f42d30-0302-412b-ad4e-970e389435c3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:23.705621 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-63f42d30-0302-412b-ad4e-970e389435c3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:23.706766 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-63f42d30-0302-412b-ad4e-970e389435c3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.148408 May 10 14:03:23.707330 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 267/507] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:23 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:24.079202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-26048a08-2923-4333-8b92-60de48424f33 req-18045209-db24-4ed0-baf5-c36cece538d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067bd8aa-a9d7-41f4-82a3-54e00fe64f68", "name": "network-vif-plugged", "status": "completed", "tag": "0b32a17e-9e2f-475d-abe1-8b69acb4c76a"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:24.088787 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-26048a08-2923-4333-8b92-60de48424f33 req-18045209-db24-4ed0-baf5-c36cece538d1 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:24.089242 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-26048a08-2923-4333-8b92-60de48424f33 req-18045209-db24-4ed0-baf5-c36cece538d1 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:24.099933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-26048a08-2923-4333-8b92-60de48424f33 req-18045209-db24-4ed0-baf5-c36cece538d1 service nova] Creating event network-vif-plugged:0b32a17e-9e2f-475d-abe1-8b69acb4c76a for instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 on hv-cinder-84067 May 10 14:03:24.105365 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-26048a08-2923-4333-8b92-60de48424f33 req-18045209-db24-4ed0-baf5-c36cece538d1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029774 May 10 14:03:24.105958 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 241/508] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:03:24.724401 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-b06a1a08-5598-46e2-8670-b9a4cd224e86 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:24.725031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-b06a1a08-5598-46e2-8670-b9a4cd224e86 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:24.731721 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b06a1a08-5598-46e2-8670-b9a4cd224e86 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:24.732194 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b06a1a08-5598-46e2-8670-b9a4cd224e86 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:24.732982 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b06a1a08-5598-46e2-8670-b9a4cd224e86 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:24.733422 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b06a1a08-5598-46e2-8670-b9a4cd224e86 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:24.861871 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-b06a1a08-5598-46e2-8670-b9a4cd224e86 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:24.871031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-b06a1a08-5598-46e2-8670-b9a4cd224e86 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:24.872584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-b06a1a08-5598-46e2-8670-b9a4cd224e86 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:24.874888 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-b06a1a08-5598-46e2-8670-b9a4cd224e86 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.153282 May 10 14:03:24.874888 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 268/509] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:24 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:25.892800 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8373cc92-5331-4f2d-99c7-5016a8df26cb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:25.893500 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8373cc92-5331-4f2d-99c7-5016a8df26cb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:25.899731 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8373cc92-5331-4f2d-99c7-5016a8df26cb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:25.900190 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8373cc92-5331-4f2d-99c7-5016a8df26cb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:25.900978 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8373cc92-5331-4f2d-99c7-5016a8df26cb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:25.901409 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8373cc92-5331-4f2d-99c7-5016a8df26cb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:26.035334 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8373cc92-5331-4f2d-99c7-5016a8df26cb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:26.043608 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8373cc92-5331-4f2d-99c7-5016a8df26cb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:26.045147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8373cc92-5331-4f2d-99c7-5016a8df26cb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:26.046327 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8373cc92-5331-4f2d-99c7-5016a8df26cb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.158621 May 10 14:03:26.046895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 242/510] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:25 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:27.064931 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-636ad66d-1a5a-4709-b83c-0a40b82eb3ea tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:27.065548 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-636ad66d-1a5a-4709-b83c-0a40b82eb3ea tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:27.072721 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-636ad66d-1a5a-4709-b83c-0a40b82eb3ea tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:27.073175 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-636ad66d-1a5a-4709-b83c-0a40b82eb3ea tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:27.073955 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-636ad66d-1a5a-4709-b83c-0a40b82eb3ea tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:27.074400 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-636ad66d-1a5a-4709-b83c-0a40b82eb3ea tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:27.211068 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-636ad66d-1a5a-4709-b83c-0a40b82eb3ea tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:27.219701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-636ad66d-1a5a-4709-b83c-0a40b82eb3ea tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:27.221259 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-636ad66d-1a5a-4709-b83c-0a40b82eb3ea tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:27.222416 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-636ad66d-1a5a-4709-b83c-0a40b82eb3ea tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1807 microversion: 2.20 time: 0.161458 May 10 14:03:27.222978 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 269/511] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:27 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:28.240626 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7de2ca6d-66cb-4a05-a295-51e53fd9717b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:28.241206 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7de2ca6d-66cb-4a05-a295-51e53fd9717b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:28.247463 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7de2ca6d-66cb-4a05-a295-51e53fd9717b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:28.247914 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7de2ca6d-66cb-4a05-a295-51e53fd9717b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:28.248723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7de2ca6d-66cb-4a05-a295-51e53fd9717b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:28.249163 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7de2ca6d-66cb-4a05-a295-51e53fd9717b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:28.377784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7de2ca6d-66cb-4a05-a295-51e53fd9717b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:28.386670 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7de2ca6d-66cb-4a05-a295-51e53fd9717b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:28.388244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7de2ca6d-66cb-4a05-a295-51e53fd9717b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:28.389398 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7de2ca6d-66cb-4a05-a295-51e53fd9717b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1794 microversion: 2.20 time: 0.152738 May 10 14:03:28.389963 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 243/512] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:03:28 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:03:37.793994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-4b0f134f-6331-4fa1-bde3-83e99590def0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:37.794927 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-4b0f134f-6331-4fa1-bde3-83e99590def0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:37.801394 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4b0f134f-6331-4fa1-bde3-83e99590def0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:37.801849 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4b0f134f-6331-4fa1-bde3-83e99590def0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:37.802617 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4b0f134f-6331-4fa1-bde3-83e99590def0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:37.803056 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4b0f134f-6331-4fa1-bde3-83e99590def0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:37.873107 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-4b0f134f-6331-4fa1-bde3-83e99590def0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "POST /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/action" status: 202 len: 0 microversion: 2.1 time: 0.082798 May 10 14:03:37.873684 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 270/513] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:03:37 2022] POST /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:03:37.882351 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-dddec17d-2784-440f-bd05-91143bdac6d3 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:37.883025 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-dddec17d-2784-440f-bd05-91143bdac6d3 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:37.889694 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dddec17d-2784-440f-bd05-91143bdac6d3 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:37.890141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dddec17d-2784-440f-bd05-91143bdac6d3 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:37.890905 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dddec17d-2784-440f-bd05-91143bdac6d3 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:37.891384 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dddec17d-2784-440f-bd05-91143bdac6d3 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:38.081896 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-dddec17d-2784-440f-bd05-91143bdac6d3 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:38.091505 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-dddec17d-2784-440f-bd05-91143bdac6d3 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1751 microversion: 2.1 time: 0.213644 May 10 14:03:38.092080 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 244/514] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:37 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1751 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:39.109840 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c383b63f-d493-48ba-8435-3ec4d5bb5954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:39.110533 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c383b63f-d493-48ba-8435-3ec4d5bb5954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:39.117711 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c383b63f-d493-48ba-8435-3ec4d5bb5954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:39.118188 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c383b63f-d493-48ba-8435-3ec4d5bb5954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:39.119036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c383b63f-d493-48ba-8435-3ec4d5bb5954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:39.119476 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c383b63f-d493-48ba-8435-3ec4d5bb5954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:39.260071 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c383b63f-d493-48ba-8435-3ec4d5bb5954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:39.267799 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c383b63f-d493-48ba-8435-3ec4d5bb5954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.162853 May 10 14:03:39.268412 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 271/515] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:39 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:40.286295 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fbe90e40-116e-4390-b6ff-6fdbecdfcc12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:40.286910 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fbe90e40-116e-4390-b6ff-6fdbecdfcc12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:40.293532 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d7181b0b-0f8b-4ba6-b93e-370172a0df6d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:40.294010 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fbe90e40-116e-4390-b6ff-6fdbecdfcc12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:40.294122 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d7181b0b-0f8b-4ba6-b93e-370172a0df6d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:40.294239 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fbe90e40-116e-4390-b6ff-6fdbecdfcc12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.294890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fbe90e40-116e-4390-b6ff-6fdbecdfcc12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:40.295358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fbe90e40-116e-4390-b6ff-6fdbecdfcc12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.299909 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d7181b0b-0f8b-4ba6-b93e-370172a0df6d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:40.300387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d7181b0b-0f8b-4ba6-b93e-370172a0df6d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.301149 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d7181b0b-0f8b-4ba6-b93e-370172a0df6d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:40.301582 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d7181b0b-0f8b-4ba6-b93e-370172a0df6d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.324690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d7181b0b-0f8b-4ba6-b93e-370172a0df6d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087/ips" status: 200 len: 151 microversion: 2.1 time: 0.034867 May 10 14:03:40.325305 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 272/516] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 14:03:40 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:40.335353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5f11fa88-3917-4660-8f19-5f1f245685d5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54e667c7-e04c-4293-a83c-2477fe4e8749"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:40.336429 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5f11fa88-3917-4660-8f19-5f1f245685d5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:40.342210 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5f11fa88-3917-4660-8f19-5f1f245685d5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:40.342654 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5f11fa88-3917-4660-8f19-5f1f245685d5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.343419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5f11fa88-3917-4660-8f19-5f1f245685d5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:40.343846 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5f11fa88-3917-4660-8f19-5f1f245685d5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.422511 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-5f11fa88-3917-4660-8f19-5f1f245685d5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Invalid volume: volume 54e667c7-e04c-4293-a83c-2477fe4e8749 is already attached to instances: 1e5f6640-8318-4ba7-be1f-7a578b595363 May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5f11fa88-3917-4660-8f19-5f1f245685d5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: POST /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087/os-volume_attachments HTTP/1.1 May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 74 May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:03:40.424267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:03:40.425725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:03:40.425725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:03:40.425725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:03:40.425725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:03:40.425725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:03:40.425725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:03:40.425725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:03:40.425725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:03:40.425725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:03:40.425725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: May 10 14:03:40.425725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {"volumeAttachment": {"volumeId": "54e667c7-e04c-4293-a83c-2477fe4e8749"}} May 10 14:03:40.425725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Invalid volume: volume 54e667c7-e04c-4293-a83c-2477fe4e8749 is already attached to instances: 1e5f6640-8318-4ba7-be1f-7a578b595363 May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'server_id': '4fa06f26-fa96-4753-9ea2-c2abecdb7087', 'body': {'volumeAttachment': {'volumeId': '54e667c7-e04c-4293-a83c-2477fe4e8749'}}} May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 54e667c7-e04c-4293-a83c-2477fe4e8749 is already attached to instances: 1e5f6640-8318-4ba7-be1f-7a578b595363 May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:40.426495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 54e667c7-e04c-4293-a83c-2477fe4e8749 is already attached to instances: 1e5f6640-8318-4ba7-be1f-7a578b595363 May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:40.427690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:40.428946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:40.428946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:03:40.428946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:03:40.428946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 54e667c7-e04c-4293-a83c-2477fe4e8749 is already attached to instances: 1e5f6640-8318-4ba7-be1f-7a578b595363 May 10 14:03:40.428946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:40.428946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5f11fa88-3917-4660-8f19-5f1f245685d5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 400 to user: Invalid volume: volume 54e667c7-e04c-4293-a83c-2477fe4e8749 is already attached to instances: 1e5f6640-8318-4ba7-be1f-7a578b595363 {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:03:40.428946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5f11fa88-3917-4660-8f19-5f1f245685d5 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094090 May 10 14:03:40.428946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 273/517] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:03:40 2022] POST /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 14:03:40.435158 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2ad9f95c-b4b8-470f-80aa-6159c8ee6b7d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:40.435618 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2ad9f95c-b4b8-470f-80aa-6159c8ee6b7d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:40.437451 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-fbe90e40-116e-4390-b6ff-6fdbecdfcc12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:40.442287 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ad9f95c-b4b8-470f-80aa-6159c8ee6b7d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:40.442743 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ad9f95c-b4b8-470f-80aa-6159c8ee6b7d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.443513 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ad9f95c-b4b8-470f-80aa-6159c8ee6b7d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:40.443952 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ad9f95c-b4b8-470f-80aa-6159c8ee6b7d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.445329 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fbe90e40-116e-4390-b6ff-6fdbecdfcc12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.162907 May 10 14:03:40.445892 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 245/518] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:40 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:40.468204 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2ad9f95c-b4b8-470f-80aa-6159c8ee6b7d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Going to try to terminate instance {{(pid=117154) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:03:40.545113 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2ad9f95c-b4b8-470f-80aa-6159c8ee6b7d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 204 len: 0 microversion: 2.1 time: 0.113423 May 10 14:03:40.545627 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 274/519] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:03:40 2022] DELETE /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:03:40.553988 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8e666fe3-438d-4b3f-b50e-21859277d2c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:40.555255 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8e666fe3-438d-4b3f-b50e-21859277d2c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:40.561187 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8e666fe3-438d-4b3f-b50e-21859277d2c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:40.561636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8e666fe3-438d-4b3f-b50e-21859277d2c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.562405 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8e666fe3-438d-4b3f-b50e-21859277d2c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:40.562838 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8e666fe3-438d-4b3f-b50e-21859277d2c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.689649 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8e666fe3-438d-4b3f-b50e-21859277d2c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:40.696920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8e666fe3-438d-4b3f-b50e-21859277d2c9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1683 microversion: 2.1 time: 0.147072 May 10 14:03:40.697489 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 246/520] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:40 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:41.463536 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-90aee02a-1862-4afb-b27b-3adf242900d0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:41.464294 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-90aee02a-1862-4afb-b27b-3adf242900d0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:41.470353 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-90aee02a-1862-4afb-b27b-3adf242900d0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:41.470804 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-90aee02a-1862-4afb-b27b-3adf242900d0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:41.471568 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-90aee02a-1862-4afb-b27b-3adf242900d0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:41.472007 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-90aee02a-1862-4afb-b27b-3adf242900d0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:41.611788 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-90aee02a-1862-4afb-b27b-3adf242900d0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:41.620052 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-90aee02a-1862-4afb-b27b-3adf242900d0 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.161466 May 10 14:03:41.620648 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 275/521] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:41 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:41.713654 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-73c30372-88ee-461d-ad4b-11dcdb30a5ab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:41.714196 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-73c30372-88ee-461d-ad4b-11dcdb30a5ab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:41.720604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-73c30372-88ee-461d-ad4b-11dcdb30a5ab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:41.721054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-73c30372-88ee-461d-ad4b-11dcdb30a5ab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:41.721822 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-73c30372-88ee-461d-ad4b-11dcdb30a5ab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:41.722258 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-73c30372-88ee-461d-ad4b-11dcdb30a5ab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:41.862857 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-73c30372-88ee-461d-ad4b-11dcdb30a5ab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:41.871517 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-73c30372-88ee-461d-ad4b-11dcdb30a5ab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1683 microversion: 2.1 time: 0.161682 May 10 14:03:41.872087 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 247/522] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:41 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:42.640649 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5a7daaad-0781-4d56-923c-2b2766f694de tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:42.641195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5a7daaad-0781-4d56-923c-2b2766f694de tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:42.647903 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5a7daaad-0781-4d56-923c-2b2766f694de tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:42.648925 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5a7daaad-0781-4d56-923c-2b2766f694de tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:42.649757 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5a7daaad-0781-4d56-923c-2b2766f694de tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:42.650264 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5a7daaad-0781-4d56-923c-2b2766f694de tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:42.791016 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5a7daaad-0781-4d56-923c-2b2766f694de tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:42.798852 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5a7daaad-0781-4d56-923c-2b2766f694de tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.164962 May 10 14:03:42.799466 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 276/523] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:42 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:42.889361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c8f96124-205a-4edd-8c2f-614ed2ebe99f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:42.889996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c8f96124-205a-4edd-8c2f-614ed2ebe99f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:42.896662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c8f96124-205a-4edd-8c2f-614ed2ebe99f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:42.897062 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c8f96124-205a-4edd-8c2f-614ed2ebe99f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:42.897872 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c8f96124-205a-4edd-8c2f-614ed2ebe99f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:42.898833 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c8f96124-205a-4edd-8c2f-614ed2ebe99f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:43.117864 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c8f96124-205a-4edd-8c2f-614ed2ebe99f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:43.125630 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c8f96124-205a-4edd-8c2f-614ed2ebe99f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1683 microversion: 2.1 time: 0.240156 May 10 14:03:43.126211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 248/524] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:42 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1683 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:43.815875 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8ce41e2b-aa3d-4673-8ce1-e29c22d95900 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:43.816595 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8ce41e2b-aa3d-4673-8ce1-e29c22d95900 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:43.822943 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8ce41e2b-aa3d-4673-8ce1-e29c22d95900 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:43.823391 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8ce41e2b-aa3d-4673-8ce1-e29c22d95900 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:43.824197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8ce41e2b-aa3d-4673-8ce1-e29c22d95900 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:43.824636 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8ce41e2b-aa3d-4673-8ce1-e29c22d95900 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:43.988723 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8ce41e2b-aa3d-4673-8ce1-e29c22d95900 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:44.000015 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8ce41e2b-aa3d-4673-8ce1-e29c22d95900 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.187894 May 10 14:03:44.000632 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 277/525] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:43 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:44.039288 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-28436840-fa13-497e-8ea4-701feca1e9d3 req-e94111a8-1ae1-4c24-8255-ff5869377d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa06f26-fa96-4753-9ea2-c2abecdb7087", "name": "network-vif-deleted", "tag": "156485a6-4fc0-40bc-a3c8-0aa824e3cae2"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:44.048709 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-28436840-fa13-497e-8ea4-701feca1e9d3 req-e94111a8-1ae1-4c24-8255-ff5869377d26 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:44.049412 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-28436840-fa13-497e-8ea4-701feca1e9d3 req-e94111a8-1ae1-4c24-8255-ff5869377d26 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:44.061415 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-28436840-fa13-497e-8ea4-701feca1e9d3 req-e94111a8-1ae1-4c24-8255-ff5869377d26 service nova] Creating event network-vif-deleted:156485a6-4fc0-40bc-a3c8-0aa824e3cae2 for instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 on hv-cinder-84067 May 10 14:03:44.067185 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-28436840-fa13-497e-8ea4-701feca1e9d3 req-e94111a8-1ae1-4c24-8255-ff5869377d26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031973 May 10 14:03:44.071578 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 249/526] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:44.143288 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d3265300-2ca5-40cf-94f6-87aea87691f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:44.144105 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d3265300-2ca5-40cf-94f6-87aea87691f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:44.152191 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d3265300-2ca5-40cf-94f6-87aea87691f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:44.152771 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d3265300-2ca5-40cf-94f6-87aea87691f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:44.153662 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d3265300-2ca5-40cf-94f6-87aea87691f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:44.154345 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d3265300-2ca5-40cf-94f6-87aea87691f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:44.224807 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d3265300-2ca5-40cf-94f6-87aea87691f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:44.234850 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d3265300-2ca5-40cf-94f6-87aea87691f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 200 len: 1327 microversion: 2.1 time: 0.094520 May 10 14:03:44.235270 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 278/527] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:44 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:45.017828 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bc010b5e-79be-4177-b789-bf9f884c1575 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:45.018562 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bc010b5e-79be-4177-b789-bf9f884c1575 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:45.025466 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bc010b5e-79be-4177-b789-bf9f884c1575 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:45.025940 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bc010b5e-79be-4177-b789-bf9f884c1575 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:45.026717 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bc010b5e-79be-4177-b789-bf9f884c1575 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:45.027290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bc010b5e-79be-4177-b789-bf9f884c1575 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:45.191244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bc010b5e-79be-4177-b789-bf9f884c1575 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:45.199236 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bc010b5e-79be-4177-b789-bf9f884c1575 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.186173 May 10 14:03:45.209416 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 250/528] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:45 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:45.251070 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-145d3c8f-6893-46cb-bfc8-b8b63e8e6590 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:45.252138 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-145d3c8f-6893-46cb-bfc8-b8b63e8e6590 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:45.262226 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-145d3c8f-6893-46cb-bfc8-b8b63e8e6590 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:45.262853 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-145d3c8f-6893-46cb-bfc8-b8b63e8e6590 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:45.263792 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-145d3c8f-6893-46cb-bfc8-b8b63e8e6590 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:45.264473 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-145d3c8f-6893-46cb-bfc8-b8b63e8e6590 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:45.280592 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-145d3c8f-6893-46cb-bfc8-b8b63e8e6590 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-145d3c8f-6893-46cb-bfc8-b8b63e8e6590 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 HTTP/1.1 May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:03:45.282521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:03:45.284142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:03:45.284142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:03:45.284142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:03:45.284142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:03:45.284142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:03:45.284142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:03:45.284142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:03:45.284142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:03:45.284142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:03:45.284142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:03:45.284142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:03:45.284142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '4fa06f26-fa96-4753-9ea2-c2abecdb7087'} May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:03:45.285276 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:03:45.286851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:45.288081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-145d3c8f-6893-46cb-bfc8-b8b63e8e6590 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 404 to user: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:03:45.288081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-145d3c8f-6893-46cb-bfc8-b8b63e8e6590 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 404 len: 111 microversion: 2.1 time: 0.036848 May 10 14:03:45.288081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 279/529] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:45 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:03:45.293725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-56456d0a-0626-4f71-b59b-e2af18a8c185 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '.version_select at 0x7f5f7c1ced30>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:45.315950 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-56456d0a-0626-4f71-b59b-e2af18a8c185 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584263563" status: 202 len: 0 microversion: 2.1 time: 0.026298 May 10 14:03:45.316859 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 251/530] 10.222.0.49 () {58 vars in 1220 bytes} [Tue May 10 14:03:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584263563 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:03:46.217571 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5b9ae1a3-8e2e-46a0-a9b6-4f799a9c2795 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:46.218331 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5b9ae1a3-8e2e-46a0-a9b6-4f799a9c2795 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:46.224300 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b45e4bc9-0d17-4ac0-9d8d-d1bb980ff355 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:46.224793 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5b9ae1a3-8e2e-46a0-a9b6-4f799a9c2795 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.224922 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b45e4bc9-0d17-4ac0-9d8d-d1bb980ff355 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:46.225417 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5b9ae1a3-8e2e-46a0-a9b6-4f799a9c2795 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.226561 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5b9ae1a3-8e2e-46a0-a9b6-4f799a9c2795 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.227111 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5b9ae1a3-8e2e-46a0-a9b6-4f799a9c2795 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.232262 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b45e4bc9-0d17-4ac0-9d8d-d1bb980ff355 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.232649 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b45e4bc9-0d17-4ac0-9d8d-d1bb980ff355 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.233431 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b45e4bc9-0d17-4ac0-9d8d-d1bb980ff355 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.233870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b45e4bc9-0d17-4ac0-9d8d-d1bb980ff355 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.369148 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-b45e4bc9-0d17-4ac0-9d8d-d1bb980ff355 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lazy-loading 'services' on Instance uuid 1e5f6640-8318-4ba7-be1f-7a578b595363 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:03:46.376880 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5b9ae1a3-8e2e-46a0-a9b6-4f799a9c2795 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:46.389035 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5b9ae1a3-8e2e-46a0-a9b6-4f799a9c2795 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.175334 May 10 14:03:46.390412 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 280/531] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:46 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:46.483953 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b45e4bc9-0d17-4ac0-9d8d-d1bb980ff355 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/os-volume_attachments/54e667c7-e04c-4293-a83c-2477fe4e8749" status: 202 len: 0 microversion: 2.1 time: 0.263352 May 10 14:03:46.484595 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 252/532] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 14:03:46 2022] DELETE /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/os-volume_attachments/54e667c7-e04c-4293-a83c-2477fe4e8749 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:03:46.493444 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e5bb10d9-f973-420e-943c-61ae0b6d45ba tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:46.494712 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e5bb10d9-f973-420e-943c-61ae0b6d45ba tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:46.502380 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5bb10d9-f973-420e-943c-61ae0b6d45ba tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.502871 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5bb10d9-f973-420e-943c-61ae0b6d45ba tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.503646 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5bb10d9-f973-420e-943c-61ae0b6d45ba tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.504076 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5bb10d9-f973-420e-943c-61ae0b6d45ba tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.534669 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e5bb10d9-f973-420e-943c-61ae0b6d45ba tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045607 May 10 14:03:46.535015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fcea0915-3b79-4499-8980-9fa42bf5bec9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e2e3ed9-e4df-4cde-b96b-ab6c909a1e3b"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:46.535229 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 281/533] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:03:46 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:46.536354 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fcea0915-3b79-4499-8980-9fa42bf5bec9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:46.542526 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fcea0915-3b79-4499-8980-9fa42bf5bec9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.542974 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fcea0915-3b79-4499-8980-9fa42bf5bec9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.543745 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fcea0915-3b79-4499-8980-9fa42bf5bec9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.544715 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fcea0915-3b79-4499-8980-9fa42bf5bec9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.636611 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-840c33ee-1ce9-4fe7-af19-e22b1e7470a9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:46.637108 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-840c33ee-1ce9-4fe7-af19-e22b1e7470a9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:46.642886 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-840c33ee-1ce9-4fe7-af19-e22b1e7470a9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.643343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-840c33ee-1ce9-4fe7-af19-e22b1e7470a9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.644109 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-840c33ee-1ce9-4fe7-af19-e22b1e7470a9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.644583 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-840c33ee-1ce9-4fe7-af19-e22b1e7470a9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.771960 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-840c33ee-1ce9-4fe7-af19-e22b1e7470a9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lazy-loading 'services' on Instance uuid c22e54ed-bbfa-42df-af34-67721740c4b0 {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:03:46.886580 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-840c33ee-1ce9-4fe7-af19-e22b1e7470a9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/os-volume_attachments/190c68b1-47f2-4e4e-9988-b6a953b7b7c5" status: 202 len: 0 microversion: 2.1 time: 0.254195 May 10 14:03:46.887245 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 282/534] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 14:03:46 2022] DELETE /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/os-volume_attachments/190c68b1-47f2-4e4e-9988-b6a953b7b7c5 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:03:47.339137 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fcea0915-3b79-4499-8980-9fa42bf5bec9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "POST /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.808385 May 10 14:03:47.339745 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 253/535] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:03:46 2022] POST /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments => generated 194 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:03:47.407633 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-36fb3d3a-6c3f-4687-8ab7-065506d490e5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:47.408366 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-36fb3d3a-6c3f-4687-8ab7-065506d490e5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:47.415270 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-36fb3d3a-6c3f-4687-8ab7-065506d490e5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:47.415722 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-36fb3d3a-6c3f-4687-8ab7-065506d490e5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:47.416518 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-36fb3d3a-6c3f-4687-8ab7-065506d490e5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:47.416959 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-36fb3d3a-6c3f-4687-8ab7-065506d490e5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:47.546925 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-579e550b-fb21-4596-a403-41fa15860b16 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:47.548009 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-579e550b-fb21-4596-a403-41fa15860b16 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:47.554619 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-579e550b-fb21-4596-a403-41fa15860b16 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:47.555141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-579e550b-fb21-4596-a403-41fa15860b16 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:47.555915 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-579e550b-fb21-4596-a403-41fa15860b16 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:47.556381 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-579e550b-fb21-4596-a403-41fa15860b16 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:47.567441 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-36fb3d3a-6c3f-4687-8ab7-065506d490e5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:47.575798 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-36fb3d3a-6c3f-4687-8ab7-065506d490e5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.172808 May 10 14:03:47.576402 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 283/536] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:47 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:47.585575 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-579e550b-fb21-4596-a403-41fa15860b16 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043307 May 10 14:03:47.586130 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 254/537] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:03:47 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:03:48.595303 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2fe53424-0325-4241-bc8d-faecfcd276d1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:48.596104 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2fe53424-0325-4241-bc8d-faecfcd276d1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:48.598842 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-654d1190-f2d5-4b1d-a47e-55551d78b42e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:48.599915 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-654d1190-f2d5-4b1d-a47e-55551d78b42e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:48.602846 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2fe53424-0325-4241-bc8d-faecfcd276d1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.603339 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2fe53424-0325-4241-bc8d-faecfcd276d1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.604112 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2fe53424-0325-4241-bc8d-faecfcd276d1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.604566 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2fe53424-0325-4241-bc8d-faecfcd276d1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.607357 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-654d1190-f2d5-4b1d-a47e-55551d78b42e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.607896 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-654d1190-f2d5-4b1d-a47e-55551d78b42e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.608786 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-654d1190-f2d5-4b1d-a47e-55551d78b42e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.609232 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-654d1190-f2d5-4b1d-a47e-55551d78b42e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.640377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-654d1190-f2d5-4b1d-a47e-55551d78b42e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046630 May 10 14:03:48.640874 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 255/538] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:03:48 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:03:48.701404 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-32b568f9-bf7b-440f-951c-ed4321d827a3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:48.703031 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-32b568f9-bf7b-440f-951c-ed4321d827a3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:48.709069 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-32b568f9-bf7b-440f-951c-ed4321d827a3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.709526 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-32b568f9-bf7b-440f-951c-ed4321d827a3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.710341 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-32b568f9-bf7b-440f-951c-ed4321d827a3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.710784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-32b568f9-bf7b-440f-951c-ed4321d827a3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.739412 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-32b568f9-bf7b-440f-951c-ed4321d827a3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Going to try to terminate instance {{(pid=117153) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:03:48.751718 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2fe53424-0325-4241-bc8d-faecfcd276d1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:48.759764 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2fe53424-0325-4241-bc8d-faecfcd276d1 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.168479 May 10 14:03:48.760389 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 284/539] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:48 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:48.813267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-32b568f9-bf7b-440f-951c-ed4321d827a3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 204 len: 0 microversion: 2.1 time: 0.119160 May 10 14:03:48.813852 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 256/540] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:03:48 2022] DELETE /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 14:03:48.822170 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cbbfb364-e1df-45c2-8dd7-98e6d9350402 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:48.823332 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-cbbfb364-e1df-45c2-8dd7-98e6d9350402 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:48.831716 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cbbfb364-e1df-45c2-8dd7-98e6d9350402 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.832608 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cbbfb364-e1df-45c2-8dd7-98e6d9350402 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.833434 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cbbfb364-e1df-45c2-8dd7-98e6d9350402 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.833881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cbbfb364-e1df-45c2-8dd7-98e6d9350402 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.966010 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-cbbfb364-e1df-45c2-8dd7-98e6d9350402 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:48.973285 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cbbfb364-e1df-45c2-8dd7-98e6d9350402 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1679 microversion: 2.1 time: 0.155080 May 10 14:03:48.973893 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 285/541] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:48 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:49.045326 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fa9104f5-027d-4988-8984-cf8cfdcdcadc tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:49.051663 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fa9104f5-027d-4988-8984-cf8cfdcdcadc tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:49.052109 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fa9104f5-027d-4988-8984-cf8cfdcdcadc tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:49.073120 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fa9104f5-027d-4988-8984-cf8cfdcdcadc tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Going to try to stop instance {{(pid=117153) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 14:03:49.113527 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fa9104f5-027d-4988-8984-cf8cfdcdcadc tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "POST /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/action" status: 202 len: 0 microversion: 2.1 time: 0.072284 May 10 14:03:49.114128 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 257/542] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:03:49 2022] POST /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:03:49.122192 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-4d6a104c-1758-4bc9-a417-89a75a462513 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:49.122806 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-4d6a104c-1758-4bc9-a417-89a75a462513 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:49.128825 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4d6a104c-1758-4bc9-a417-89a75a462513 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:49.129339 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4d6a104c-1758-4bc9-a417-89a75a462513 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:49.130163 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4d6a104c-1758-4bc9-a417-89a75a462513 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:49.130629 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4d6a104c-1758-4bc9-a417-89a75a462513 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:49.254268 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-4d6a104c-1758-4bc9-a417-89a75a462513 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:49.261922 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-4d6a104c-1758-4bc9-a417-89a75a462513 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.143592 May 10 14:03:49.262493 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 286/543] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:49 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:49.777880 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-221104cb-be34-4a8e-8ff4-d440b2b25d63 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:49.778569 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-221104cb-be34-4a8e-8ff4-d440b2b25d63 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:49.784652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-221104cb-be34-4a8e-8ff4-d440b2b25d63 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:49.785092 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-221104cb-be34-4a8e-8ff4-d440b2b25d63 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:49.785846 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-221104cb-be34-4a8e-8ff4-d440b2b25d63 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:49.786276 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-221104cb-be34-4a8e-8ff4-d440b2b25d63 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:49.936901 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-221104cb-be34-4a8e-8ff4-d440b2b25d63 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:49.945317 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-221104cb-be34-4a8e-8ff4-d440b2b25d63 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.171413 May 10 14:03:49.945884 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 258/544] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:49 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:49.990533 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e06452c6-14ef-452c-8b6b-a0028becc4aa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:49.991150 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e06452c6-14ef-452c-8b6b-a0028becc4aa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:49.997944 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e06452c6-14ef-452c-8b6b-a0028becc4aa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:49.998394 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e06452c6-14ef-452c-8b6b-a0028becc4aa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:49.999150 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e06452c6-14ef-452c-8b6b-a0028becc4aa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:49.999608 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e06452c6-14ef-452c-8b6b-a0028becc4aa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:50.123283 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e06452c6-14ef-452c-8b6b-a0028becc4aa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:50.130525 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e06452c6-14ef-452c-8b6b-a0028becc4aa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1679 microversion: 2.1 time: 0.143742 May 10 14:03:50.131095 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 287/545] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:49 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1679 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:50.278741 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a5f761f9-8e90-4083-b448-5b352732af34 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:50.279343 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a5f761f9-8e90-4083-b448-5b352732af34 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:50.285369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a5f761f9-8e90-4083-b448-5b352732af34 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:50.285824 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a5f761f9-8e90-4083-b448-5b352732af34 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:50.286586 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a5f761f9-8e90-4083-b448-5b352732af34 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:50.287050 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a5f761f9-8e90-4083-b448-5b352732af34 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:50.412414 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a5f761f9-8e90-4083-b448-5b352732af34 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:50.420611 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a5f761f9-8e90-4083-b448-5b352732af34 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1723 microversion: 2.1 time: 0.145704 May 10 14:03:50.421183 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 259/546] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:50 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:50.962093 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7f28e8c7-c7b2-4183-a063-ee3e5f256b6e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:50.962704 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7f28e8c7-c7b2-4183-a063-ee3e5f256b6e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:50.968507 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7f28e8c7-c7b2-4183-a063-ee3e5f256b6e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:50.968944 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7f28e8c7-c7b2-4183-a063-ee3e5f256b6e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:50.969722 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7f28e8c7-c7b2-4183-a063-ee3e5f256b6e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:50.970157 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7f28e8c7-c7b2-4183-a063-ee3e5f256b6e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:51.114197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7f28e8c7-c7b2-4183-a063-ee3e5f256b6e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:51.122561 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7f28e8c7-c7b2-4183-a063-ee3e5f256b6e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.164369 May 10 14:03:51.123130 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 288/547] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:50 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:51.147035 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0e8aba90-a91b-431f-98e3-c65f56ea777e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:51.147648 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0e8aba90-a91b-431f-98e3-c65f56ea777e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:51.153953 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0e8aba90-a91b-431f-98e3-c65f56ea777e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:51.154400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0e8aba90-a91b-431f-98e3-c65f56ea777e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:51.155188 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0e8aba90-a91b-431f-98e3-c65f56ea777e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:51.155623 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0e8aba90-a91b-431f-98e3-c65f56ea777e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:51.316476 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0e8aba90-a91b-431f-98e3-c65f56ea777e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:51.324794 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0e8aba90-a91b-431f-98e3-c65f56ea777e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1679 microversion: 2.1 time: 0.181440 May 10 14:03:51.325377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 260/548] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:51 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:51.438011 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d5d04799-0078-4c7f-8f55-c857ec3a0ea8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:51.438626 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d5d04799-0078-4c7f-8f55-c857ec3a0ea8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:51.445006 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d5d04799-0078-4c7f-8f55-c857ec3a0ea8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:51.445461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d5d04799-0078-4c7f-8f55-c857ec3a0ea8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:51.446232 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d5d04799-0078-4c7f-8f55-c857ec3a0ea8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:51.446668 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d5d04799-0078-4c7f-8f55-c857ec3a0ea8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:51.585734 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d5d04799-0078-4c7f-8f55-c857ec3a0ea8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:51.603256 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d5d04799-0078-4c7f-8f55-c857ec3a0ea8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1677 microversion: 2.1 time: 0.169035 May 10 14:03:51.604468 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 289/549] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:51 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:52.138758 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-2b7c71ba-909b-4364-9a15-5d2cd765515f req-5c215b6a-032e-4af6-ab0b-2762d6d95334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e5f6640-8318-4ba7-be1f-7a578b595363", "name": "network-vif-deleted", "tag": "11a4481d-f88f-4503-b4d7-f6b62b846773"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:52.148589 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-508eb3c2-cdac-4066-8a37-3f6e4e9fa1bb tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:52.149807 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-508eb3c2-cdac-4066-8a37-3f6e4e9fa1bb tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:52.151149 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-2b7c71ba-909b-4364-9a15-5d2cd765515f req-5c215b6a-032e-4af6-ab0b-2762d6d95334 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.151886 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-2b7c71ba-909b-4364-9a15-5d2cd765515f req-5c215b6a-032e-4af6-ab0b-2762d6d95334 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.164662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-2b7c71ba-909b-4364-9a15-5d2cd765515f req-5c215b6a-032e-4af6-ab0b-2762d6d95334 service nova] Creating event network-vif-deleted:11a4481d-f88f-4503-b4d7-f6b62b846773 for instance 1e5f6640-8318-4ba7-be1f-7a578b595363 on hv-cinder-84067 May 10 14:03:52.165504 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-508eb3c2-cdac-4066-8a37-3f6e4e9fa1bb tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.165964 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-508eb3c2-cdac-4066-8a37-3f6e4e9fa1bb tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.166818 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-508eb3c2-cdac-4066-8a37-3f6e4e9fa1bb tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.170174 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-508eb3c2-cdac-4066-8a37-3f6e4e9fa1bb tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.170764 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-2b7c71ba-909b-4364-9a15-5d2cd765515f req-5c215b6a-032e-4af6-ab0b-2762d6d95334 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037246 May 10 14:03:52.172137 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 261/550] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:52.343685 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f637aa68-0bb9-4bb5-a78b-b322da05931a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:52.344777 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f637aa68-0bb9-4bb5-a78b-b322da05931a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:52.349074 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-508eb3c2-cdac-4066-8a37-3f6e4e9fa1bb tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:52.352127 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f637aa68-0bb9-4bb5-a78b-b322da05931a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.352672 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f637aa68-0bb9-4bb5-a78b-b322da05931a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.353709 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f637aa68-0bb9-4bb5-a78b-b322da05931a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.354375 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f637aa68-0bb9-4bb5-a78b-b322da05931a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.360280 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-508eb3c2-cdac-4066-8a37-3f6e4e9fa1bb tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.222233 May 10 14:03:52.361082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 290/551] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:52 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:52.397402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f637aa68-0bb9-4bb5-a78b-b322da05931a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.398001 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f637aa68-0bb9-4bb5-a78b-b322da05931a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.398666 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-f637aa68-0bb9-4bb5-a78b-b322da05931a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lazy-loading 'fault' on Instance uuid 1e5f6640-8318-4ba7-be1f-7a578b595363 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:03:52.444195 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f637aa68-0bb9-4bb5-a78b-b322da05931a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:52.452030 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f637aa68-0bb9-4bb5-a78b-b322da05931a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 200 len: 1330 microversion: 2.1 time: 0.113348 May 10 14:03:52.452738 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 262/552] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:52 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:52.624562 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cad45ea9-287f-4ecd-b12e-4b65b22bf951 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:52.625443 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-cad45ea9-287f-4ecd-b12e-4b65b22bf951 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:52.632458 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cad45ea9-287f-4ecd-b12e-4b65b22bf951 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.633564 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cad45ea9-287f-4ecd-b12e-4b65b22bf951 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.634310 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cad45ea9-287f-4ecd-b12e-4b65b22bf951 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.635184 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cad45ea9-287f-4ecd-b12e-4b65b22bf951 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.773439 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-cad45ea9-287f-4ecd-b12e-4b65b22bf951 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:52.781863 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cad45ea9-287f-4ecd-b12e-4b65b22bf951 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1677 microversion: 2.1 time: 0.161760 May 10 14:03:52.787686 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 291/553] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:52 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:53.377679 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3d780573-3d83-47a7-873e-f87768b305f5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:53.378295 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-3d780573-3d83-47a7-873e-f87768b305f5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:53.385080 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3d780573-3d83-47a7-873e-f87768b305f5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.385852 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3d780573-3d83-47a7-873e-f87768b305f5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:53.386873 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3d780573-3d83-47a7-873e-f87768b305f5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.387316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3d780573-3d83-47a7-873e-f87768b305f5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:53.469874 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8abd79ce-407c-448e-adba-5e044a23ab3e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:53.470626 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8abd79ce-407c-448e-adba-5e044a23ab3e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:53.478021 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8abd79ce-407c-448e-adba-5e044a23ab3e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.478479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8abd79ce-407c-448e-adba-5e044a23ab3e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:53.479254 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8abd79ce-407c-448e-adba-5e044a23ab3e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.479691 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8abd79ce-407c-448e-adba-5e044a23ab3e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:53.493940 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-8abd79ce-407c-448e-adba-5e044a23ab3e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8abd79ce-407c-448e-adba-5e044a23ab3e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 HTTP/1.1 May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:03:53.495599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:03:53.497253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:03:53.497253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:03:53.497253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:03:53.497253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:03:53.497253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:03:53.497253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:03:53.497253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:03:53.497253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:03:53.497253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:03:53.497253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:03:53.497253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:03:53.497253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '1e5f6640-8318-4ba7-be1f-7a578b595363'} May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:03:53.498036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:03:53.499317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:03:53.500597 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8abd79ce-407c-448e-adba-5e044a23ab3e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 404 to user: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:03:53.500597 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8abd79ce-407c-448e-adba-5e044a23ab3e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 404 len: 111 microversion: 2.1 time: 0.031779 May 10 14:03:53.500597 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 292/554] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:53 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:03:53.505541 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8819cb6b-8b39-4877-9c0d-f840a84e9890 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '.version_select at 0x7f5f7c02e940>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:53.525902 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8819cb6b-8b39-4877-9c0d-f840a84e9890 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466898890" status: 202 len: 0 microversion: 2.1 time: 0.023830 May 10 14:03:53.526485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 293/555] 10.222.0.49 () {58 vars in 1220 bytes} [Tue May 10 14:03:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466898890 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:03:53.532464 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3d780573-3d83-47a7-873e-f87768b305f5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:53.541430 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3d780573-3d83-47a7-873e-f87768b305f5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.167516 May 10 14:03:53.542617 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 263/556] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:53 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:53.799045 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f6a2325e-d18d-450c-a70b-56d3ed1a1fcf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:53.799408 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f6a2325e-d18d-450c-a70b-56d3ed1a1fcf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:53.805280 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f6a2325e-d18d-450c-a70b-56d3ed1a1fcf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.805747 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f6a2325e-d18d-450c-a70b-56d3ed1a1fcf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:53.806509 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f6a2325e-d18d-450c-a70b-56d3ed1a1fcf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.806967 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f6a2325e-d18d-450c-a70b-56d3ed1a1fcf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:54.028446 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f6a2325e-d18d-450c-a70b-56d3ed1a1fcf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:54.035817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f6a2325e-d18d-450c-a70b-56d3ed1a1fcf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1677 microversion: 2.1 time: 0.240875 May 10 14:03:54.036413 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 294/557] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:53 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1677 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:54.232996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3f535bb3-ba3d-40c7-aab9-8dec80cdb1f9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: .version_select at 0x7f5f7c1cec10>, body: {"keypair": {"name": "tempest-keypair-1813450794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXhJ+L+lMXLqOJGSxLSGA1lK1SeGNyoFonGAguQx9mmTpGwMHhEH+rrRmhp4DHDKyYAjZmhZ4OpytpDre7va7Oxrmz0WnC7lYy8yzq408EKpJlyM4qjS218tSWVxiRZ1g=="}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:54.247948 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-3f535bb3-ba3d-40c7-aab9-8dec80cdb1f9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:03:54.251847 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-3f535bb3-ba3d-40c7-aab9-8dec80cdb1f9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for user 8c563c6a229b4e619992ccfb0da1a748 and project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:03:54.273717 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3f535bb3-ba3d-40c7-aab9-8dec80cdb1f9 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044571 May 10 14:03:54.274303 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 264/558] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 14:03:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:54.558845 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c8a9ad6a-2032-4a5e-9c50-99246fe5f068 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:54.559461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c8a9ad6a-2032-4a5e-9c50-99246fe5f068 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:54.565753 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8a9ad6a-2032-4a5e-9c50-99246fe5f068 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:54.566211 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8a9ad6a-2032-4a5e-9c50-99246fe5f068 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:54.566990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8a9ad6a-2032-4a5e-9c50-99246fe5f068 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:54.567432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8a9ad6a-2032-4a5e-9c50-99246fe5f068 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:54.742389 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c8a9ad6a-2032-4a5e-9c50-99246fe5f068 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:54.755207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c8a9ad6a-2032-4a5e-9c50-99246fe5f068 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.200067 May 10 14:03:54.756509 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 295/559] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:54 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:55.055970 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e3ab5046-3913-48b3-b84a-b3e98f805ba6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:55.056614 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e3ab5046-3913-48b3-b84a-b3e98f805ba6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:55.062383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e3ab5046-3913-48b3-b84a-b3e98f805ba6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:55.062833 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e3ab5046-3913-48b3-b84a-b3e98f805ba6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:55.063735 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e3ab5046-3913-48b3-b84a-b3e98f805ba6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:55.064216 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e3ab5046-3913-48b3-b84a-b3e98f805ba6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:55.273595 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e3ab5046-3913-48b3-b84a-b3e98f805ba6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:55.281156 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e3ab5046-3913-48b3-b84a-b3e98f805ba6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1677 microversion: 2.1 time: 0.231729 May 10 14:03:55.281742 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 265/560] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:55 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:55.668429 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1858771581", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c9ceeee-200d-4bc2-b027-788cdb69321a"}], "security_groups": [{"name": "tempest-securitygroup--838268663"}], "key_name": "tempest-keypair-1813450794", "user_data": "}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:55.766735 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] validate_networks() for [('2c9ceeee-200d-4bc2-b027-788cdb69321a', None, None, None, None, None)] {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:03:55.773366 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6a757c98-404f-445c-9dea-ab131048979f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:55.773976 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-6a757c98-404f-445c-9dea-ab131048979f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:55.780087 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6a757c98-404f-445c-9dea-ab131048979f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:55.780586 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6a757c98-404f-445c-9dea-ab131048979f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:55.781361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6a757c98-404f-445c-9dea-ab131048979f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:55.781796 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6a757c98-404f-445c-9dea-ab131048979f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:55.932895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6a757c98-404f-445c-9dea-ab131048979f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:55.940825 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6a757c98-404f-445c-9dea-ab131048979f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1756 microversion: 2.1 time: 0.171378 May 10 14:03:55.941784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 266/561] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:55 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:56.132717 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:03:56.133259 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:03:56.133734 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:03:56.134138 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:03:56.134543 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:03:56.143081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:56.143525 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:56.144355 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:56.144791 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:56.161046 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:03:56.165960 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for user 8c563c6a229b4e619992ccfb0da1a748 and project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:03:56.176570 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:03:56.179423 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:03:56.222543 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a713e960-bf9b-4934-8f66-7c8fe061756b tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.558370 May 10 14:03:56.223201 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 296/562] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:03:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 14:03:56.233496 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e1a8eca8-c433-40e3-8e73-dc620d09cd4d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:56.234115 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e1a8eca8-c433-40e3-8e73-dc620d09cd4d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:56.286990 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e1a8eca8-c433-40e3-8e73-dc620d09cd4d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:56.294545 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e1a8eca8-c433-40e3-8e73-dc620d09cd4d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1242 microversion: 2.1 time: 0.064725 May 10 14:03:56.295318 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 267/563] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:56 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:56.298501 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-6f4efcbd-8f35-48f8-8021-05adc098f8ce tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:56.299217 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-6f4efcbd-8f35-48f8-8021-05adc098f8ce tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:56.306095 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6f4efcbd-8f35-48f8-8021-05adc098f8ce tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:56.306551 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6f4efcbd-8f35-48f8-8021-05adc098f8ce tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:56.307322 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6f4efcbd-8f35-48f8-8021-05adc098f8ce tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:56.307763 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6f4efcbd-8f35-48f8-8021-05adc098f8ce tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:56.444137 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-6f4efcbd-8f35-48f8-8021-05adc098f8ce tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:56.451875 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-6f4efcbd-8f35-48f8-8021-05adc098f8ce tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1677 microversion: 2.1 time: 0.157574 May 10 14:03:56.452487 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 297/564] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:56 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:56.958404 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-269694b6-c984-4ef0-b12c-8d040ea04da8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:56.959022 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-269694b6-c984-4ef0-b12c-8d040ea04da8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:56.965685 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-269694b6-c984-4ef0-b12c-8d040ea04da8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:56.966139 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-269694b6-c984-4ef0-b12c-8d040ea04da8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:56.966951 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-269694b6-c984-4ef0-b12c-8d040ea04da8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:56.967389 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-269694b6-c984-4ef0-b12c-8d040ea04da8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:57.113002 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-269694b6-c984-4ef0-b12c-8d040ea04da8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:57.121216 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-269694b6-c984-4ef0-b12c-8d040ea04da8 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1759 microversion: 2.1 time: 0.166700 May 10 14:03:57.121787 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 268/565] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:56 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:57.312206 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-38fd8ac4-5ac2-430a-b4a8-a59d9b5d9ced tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:57.312828 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-38fd8ac4-5ac2-430a-b4a8-a59d9b5d9ced tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:57.321316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-38fd8ac4-5ac2-430a-b4a8-a59d9b5d9ced tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:57.321535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-38fd8ac4-5ac2-430a-b4a8-a59d9b5d9ced tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:57.322863 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-38fd8ac4-5ac2-430a-b4a8-a59d9b5d9ced tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:57.323387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-38fd8ac4-5ac2-430a-b4a8-a59d9b5d9ced tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:57.390438 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-38fd8ac4-5ac2-430a-b4a8-a59d9b5d9ced tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:57.398624 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-38fd8ac4-5ac2-430a-b4a8-a59d9b5d9ced tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1246 microversion: 2.1 time: 0.090421 May 10 14:03:57.399192 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 298/566] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:57 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:57.469314 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e0ef37cb-3098-45a7-bc1d-070df7045e70 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:57.469926 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e0ef37cb-3098-45a7-bc1d-070df7045e70 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:57.476770 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e0ef37cb-3098-45a7-bc1d-070df7045e70 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:57.477223 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e0ef37cb-3098-45a7-bc1d-070df7045e70 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:57.477992 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e0ef37cb-3098-45a7-bc1d-070df7045e70 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:57.478433 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e0ef37cb-3098-45a7-bc1d-070df7045e70 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:57.603243 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e0ef37cb-3098-45a7-bc1d-070df7045e70 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:57.610605 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e0ef37cb-3098-45a7-bc1d-070df7045e70 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1677 microversion: 2.1 time: 0.145108 May 10 14:03:57.611181 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 269/567] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:57 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:58.006975 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-54875445-1531-422e-a4dd-dfbd5f5f78ca tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:58.008656 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-54875445-1531-422e-a4dd-dfbd5f5f78ca tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:58.015296 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-54875445-1531-422e-a4dd-dfbd5f5f78ca tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:58.015751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-54875445-1531-422e-a4dd-dfbd5f5f78ca tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:58.016551 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-54875445-1531-422e-a4dd-dfbd5f5f78ca tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:58.016989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-54875445-1531-422e-a4dd-dfbd5f5f78ca tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:58.040243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-54875445-1531-422e-a4dd-dfbd5f5f78ca tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lazy-loading 'flavor' on Instance uuid 2a730d46-5e87-4a26-a9fc-4486e99bcf5a {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:03:58.155006 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-54875445-1531-422e-a4dd-dfbd5f5f78ca tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "POST /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/action" status: 200 len: 32 microversion: 2.1 time: 0.151950 May 10 14:03:58.159638 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 299/568] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:03:58 2022] POST /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:03:58.166774 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0f8fc4ee-12f7-49bf-955f-3486df1e954f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:58.167897 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0f8fc4ee-12f7-49bf-955f-3486df1e954f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:58.175636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0f8fc4ee-12f7-49bf-955f-3486df1e954f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:58.176101 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0f8fc4ee-12f7-49bf-955f-3486df1e954f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:58.176935 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0f8fc4ee-12f7-49bf-955f-3486df1e954f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:58.177621 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0f8fc4ee-12f7-49bf-955f-3486df1e954f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:58.417761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a2a8754a-8c4d-483c-83e2-07db9b1c3eab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:58.418793 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a2a8754a-8c4d-483c-83e2-07db9b1c3eab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:58.425154 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a2a8754a-8c4d-483c-83e2-07db9b1c3eab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:58.425907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a2a8754a-8c4d-483c-83e2-07db9b1c3eab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:58.426755 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a2a8754a-8c4d-483c-83e2-07db9b1c3eab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:58.427261 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a2a8754a-8c4d-483c-83e2-07db9b1c3eab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:58.455214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0f8fc4ee-12f7-49bf-955f-3486df1e954f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:58.464400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0f8fc4ee-12f7-49bf-955f-3486df1e954f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.303341 May 10 14:03:58.475677 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 270/569] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:58 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:58.491824 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a2a8754a-8c4d-483c-83e2-07db9b1c3eab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:58.500422 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a2a8754a-8c4d-483c-83e2-07db9b1c3eab tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1312 microversion: 2.1 time: 0.089096 May 10 14:03:58.501096 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 300/570] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:58 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:58.626732 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-61fb8400-248b-4a38-b154-7cb3ebad960e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:58.627584 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-61fb8400-248b-4a38-b154-7cb3ebad960e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:58.634830 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-61fb8400-248b-4a38-b154-7cb3ebad960e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:58.635206 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-61fb8400-248b-4a38-b154-7cb3ebad960e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:58.635996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-61fb8400-248b-4a38-b154-7cb3ebad960e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:58.636517 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-61fb8400-248b-4a38-b154-7cb3ebad960e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:58.918166 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-61fb8400-248b-4a38-b154-7cb3ebad960e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:58.925526 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-61fb8400-248b-4a38-b154-7cb3ebad960e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1677 microversion: 2.1 time: 0.302640 May 10 14:03:58.926109 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 271/571] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:58 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1677 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:59.482288 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ff2ccb7e-5c35-4c19-a68c-7c0f7541886b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:59.482910 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ff2ccb7e-5c35-4c19-a68c-7c0f7541886b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:59.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ff2ccb7e-5c35-4c19-a68c-7c0f7541886b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:59.489671 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ff2ccb7e-5c35-4c19-a68c-7c0f7541886b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:59.490445 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ff2ccb7e-5c35-4c19-a68c-7c0f7541886b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:59.490879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ff2ccb7e-5c35-4c19-a68c-7c0f7541886b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:59.518268 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f89d591e-bf04-4db5-9bb5-13a457f66b52 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:59.519140 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f89d591e-bf04-4db5-9bb5-13a457f66b52 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:59.526289 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f89d591e-bf04-4db5-9bb5-13a457f66b52 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:59.527058 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f89d591e-bf04-4db5-9bb5-13a457f66b52 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:59.528005 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f89d591e-bf04-4db5-9bb5-13a457f66b52 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:59.528626 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f89d591e-bf04-4db5-9bb5-13a457f66b52 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:59.608203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f89d591e-bf04-4db5-9bb5-13a457f66b52 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:59.615767 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f89d591e-bf04-4db5-9bb5-13a457f66b52 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1300 microversion: 2.1 time: 0.102103 May 10 14:03:59.616519 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 272/572] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:59 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:59.628526 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ff2ccb7e-5c35-4c19-a68c-7c0f7541886b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:59.636248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ff2ccb7e-5c35-4c19-a68c-7c0f7541886b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.157850 May 10 14:03:59.636814 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 301/573] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:59 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:59.942905 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-56afb660-2023-48e3-842c-c9408874a5d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:59.943523 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-56afb660-2023-48e3-842c-c9408874a5d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:59.950179 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-56afb660-2023-48e3-842c-c9408874a5d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:59.950782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-56afb660-2023-48e3-842c-c9408874a5d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:59.951397 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-56afb660-2023-48e3-842c-c9408874a5d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:59.952114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-56afb660-2023-48e3-842c-c9408874a5d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:00.154380 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-56afb660-2023-48e3-842c-c9408874a5d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:00.161637 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-56afb660-2023-48e3-842c-c9408874a5d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1677 microversion: 2.1 time: 0.222577 May 10 14:04:00.162214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 273/574] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:03:59 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:00.489705 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-f89429cc-ebcc-4ed2-8bd5-26c404ccfd4c req-efc02ad7-d335-4147-a0f3-88946a5eb09b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ade9bf-f1d4-454c-928b-bb882c680d30", "tag": "41e1a591-ff64-4acf-8e49-bb32771685e9"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:00.500554 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-f89429cc-ebcc-4ed2-8bd5-26c404ccfd4c req-efc02ad7-d335-4147-a0f3-88946a5eb09b service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:00.501334 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-f89429cc-ebcc-4ed2-8bd5-26c404ccfd4c req-efc02ad7-d335-4147-a0f3-88946a5eb09b service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:00.527557 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-f89429cc-ebcc-4ed2-8bd5-26c404ccfd4c req-efc02ad7-d335-4147-a0f3-88946a5eb09b service nova] Creating event network-changed:41e1a591-ff64-4acf-8e49-bb32771685e9 for instance 61ade9bf-f1d4-454c-928b-bb882c680d30 on hv-cinder-84067 May 10 14:04:00.532507 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-f89429cc-ebcc-4ed2-8bd5-26c404ccfd4c req-efc02ad7-d335-4147-a0f3-88946a5eb09b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047090 May 10 14:04:00.533446 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 302/575] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:00.633643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-cb59e954-44f5-4f35-8df4-44bdae696231 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:00.634921 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-cb59e954-44f5-4f35-8df4-44bdae696231 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:00.641381 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cb59e954-44f5-4f35-8df4-44bdae696231 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:00.641948 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cb59e954-44f5-4f35-8df4-44bdae696231 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:00.642812 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cb59e954-44f5-4f35-8df4-44bdae696231 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:00.644104 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cb59e954-44f5-4f35-8df4-44bdae696231 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:00.655413 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-376aba6c-c9bd-4318-a0a2-69a4c906ac0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:00.656116 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-376aba6c-c9bd-4318-a0a2-69a4c906ac0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:00.665342 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-376aba6c-c9bd-4318-a0a2-69a4c906ac0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:00.665795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-376aba6c-c9bd-4318-a0a2-69a4c906ac0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:00.666577 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-376aba6c-c9bd-4318-a0a2-69a4c906ac0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:00.667321 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-376aba6c-c9bd-4318-a0a2-69a4c906ac0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:00.819042 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-376aba6c-c9bd-4318-a0a2-69a4c906ac0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:00.827705 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-376aba6c-c9bd-4318-a0a2-69a4c906ac0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.176428 May 10 14:04:00.828543 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 303/576] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:00 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:00.863467 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-cb59e954-44f5-4f35-8df4-44bdae696231 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:00.870823 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-cb59e954-44f5-4f35-8df4-44bdae696231 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1367 microversion: 2.1 time: 0.241681 May 10 14:04:00.871396 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 274/577] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:00 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:01.178698 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f52b5500-43c1-4878-be25-c1bb23d75e68 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:01.179803 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f52b5500-43c1-4878-be25-c1bb23d75e68 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:01.185670 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f52b5500-43c1-4878-be25-c1bb23d75e68 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:01.186122 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f52b5500-43c1-4878-be25-c1bb23d75e68 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:01.186884 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f52b5500-43c1-4878-be25-c1bb23d75e68 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:01.187320 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f52b5500-43c1-4878-be25-c1bb23d75e68 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:01.312617 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f52b5500-43c1-4878-be25-c1bb23d75e68 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:01.319793 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f52b5500-43c1-4878-be25-c1bb23d75e68 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1677 microversion: 2.1 time: 0.144944 May 10 14:04:01.320721 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 304/578] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:01 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:01.845347 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c9e8e01e-ad11-4dc8-a23b-ca2d229fbe0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:01.845913 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c9e8e01e-ad11-4dc8-a23b-ca2d229fbe0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:01.852981 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9e8e01e-ad11-4dc8-a23b-ca2d229fbe0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:01.853434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9e8e01e-ad11-4dc8-a23b-ca2d229fbe0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:01.854203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9e8e01e-ad11-4dc8-a23b-ca2d229fbe0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:01.854641 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9e8e01e-ad11-4dc8-a23b-ca2d229fbe0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:01.888584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f2302806-ab9d-41e4-a826-4ed5ab8c65ac tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:01.889204 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f2302806-ab9d-41e4-a826-4ed5ab8c65ac tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:01.896076 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f2302806-ab9d-41e4-a826-4ed5ab8c65ac tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:01.896563 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f2302806-ab9d-41e4-a826-4ed5ab8c65ac tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:01.897350 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f2302806-ab9d-41e4-a826-4ed5ab8c65ac tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:01.897797 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f2302806-ab9d-41e4-a826-4ed5ab8c65ac tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:01.986210 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c9e8e01e-ad11-4dc8-a23b-ca2d229fbe0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:01.994157 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c9e8e01e-ad11-4dc8-a23b-ca2d229fbe0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.152671 May 10 14:04:01.994735 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 275/579] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:01 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:02.030164 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f2302806-ab9d-41e4-a826-4ed5ab8c65ac tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:02.037417 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f2302806-ab9d-41e4-a826-4ed5ab8c65ac tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1367 microversion: 2.1 time: 0.153992 May 10 14:04:02.037983 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 305/580] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:01 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:02.336843 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2e7b95a3-7a58-45cb-8267-bc3b3bdfbd16 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:02.337459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2e7b95a3-7a58-45cb-8267-bc3b3bdfbd16 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:02.343705 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2e7b95a3-7a58-45cb-8267-bc3b3bdfbd16 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:02.344154 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2e7b95a3-7a58-45cb-8267-bc3b3bdfbd16 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:02.344957 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2e7b95a3-7a58-45cb-8267-bc3b3bdfbd16 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:02.345396 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2e7b95a3-7a58-45cb-8267-bc3b3bdfbd16 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:02.518717 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2e7b95a3-7a58-45cb-8267-bc3b3bdfbd16 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:02.526314 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2e7b95a3-7a58-45cb-8267-bc3b3bdfbd16 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1654 microversion: 2.1 time: 0.193928 May 10 14:04:02.526883 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 276/581] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:02 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1654 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:02.542957 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ac5c7446-7e51-4d34-b28e-72cdb82d0e3f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:02.549329 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ac5c7446-7e51-4d34-b28e-72cdb82d0e3f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:02.549778 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ac5c7446-7e51-4d34-b28e-72cdb82d0e3f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:02.610283 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ac5c7446-7e51-4d34-b28e-72cdb82d0e3f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Going to try to start instance {{(pid=117154) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 14:04:02.655041 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ac5c7446-7e51-4d34-b28e-72cdb82d0e3f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "POST /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/action" status: 202 len: 0 microversion: 2.1 time: 0.115734 May 10 14:04:02.655653 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 306/582] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:04:02 2022] POST /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:04:02.664069 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-35052b21-b513-4b9a-be2a-217192fb17c6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:02.664811 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-35052b21-b513-4b9a-be2a-217192fb17c6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:02.671082 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-35052b21-b513-4b9a-be2a-217192fb17c6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:02.671616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-35052b21-b513-4b9a-be2a-217192fb17c6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:02.672516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-35052b21-b513-4b9a-be2a-217192fb17c6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:02.673054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-35052b21-b513-4b9a-be2a-217192fb17c6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:02.803136 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-35052b21-b513-4b9a-be2a-217192fb17c6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:02.811874 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-35052b21-b513-4b9a-be2a-217192fb17c6 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1663 microversion: 2.1 time: 0.151715 May 10 14:04:02.812659 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 277/583] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:02 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:03.013693 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c3cdd59c-7ce2-493f-90a6-a3c44692ff78 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:03.014540 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c3cdd59c-7ce2-493f-90a6-a3c44692ff78 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:03.021969 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c3cdd59c-7ce2-493f-90a6-a3c44692ff78 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:03.022422 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c3cdd59c-7ce2-493f-90a6-a3c44692ff78 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:03.023255 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c3cdd59c-7ce2-493f-90a6-a3c44692ff78 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:03.023694 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c3cdd59c-7ce2-493f-90a6-a3c44692ff78 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:03.055151 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-571d3db2-bff0-49ae-a964-43348add03b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:03.055703 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-571d3db2-bff0-49ae-a964-43348add03b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:03.062079 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-571d3db2-bff0-49ae-a964-43348add03b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:03.062529 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-571d3db2-bff0-49ae-a964-43348add03b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:03.063520 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-571d3db2-bff0-49ae-a964-43348add03b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:03.063958 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-571d3db2-bff0-49ae-a964-43348add03b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:03.172359 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c3cdd59c-7ce2-493f-90a6-a3c44692ff78 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:03.181226 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c3cdd59c-7ce2-493f-90a6-a3c44692ff78 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.172143 May 10 14:04:03.181812 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 307/584] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:03 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:03.264006 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-571d3db2-bff0-49ae-a964-43348add03b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:03.271665 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-571d3db2-bff0-49ae-a964-43348add03b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1367 microversion: 2.1 time: 0.220944 May 10 14:04:03.272684 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 278/585] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:03 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:03.829569 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3b61651c-1ad6-464a-aa5a-25d3b9ac4f41 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:03.830096 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3b61651c-1ad6-464a-aa5a-25d3b9ac4f41 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:03.836652 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3b61651c-1ad6-464a-aa5a-25d3b9ac4f41 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:03.837096 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3b61651c-1ad6-464a-aa5a-25d3b9ac4f41 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:03.837863 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3b61651c-1ad6-464a-aa5a-25d3b9ac4f41 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:03.838304 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3b61651c-1ad6-464a-aa5a-25d3b9ac4f41 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:03.965828 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3b61651c-1ad6-464a-aa5a-25d3b9ac4f41 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:03.973133 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3b61651c-1ad6-464a-aa5a-25d3b9ac4f41 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1663 microversion: 2.1 time: 0.147567 May 10 14:04:03.973713 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 308/586] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:03 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:04.197968 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-75b94dc6-316f-4ea0-a1c7-894aa5e7b682 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:04.198581 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-75b94dc6-316f-4ea0-a1c7-894aa5e7b682 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:04.204839 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-75b94dc6-316f-4ea0-a1c7-894aa5e7b682 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:04.205292 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-75b94dc6-316f-4ea0-a1c7-894aa5e7b682 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:04.206064 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-75b94dc6-316f-4ea0-a1c7-894aa5e7b682 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:04.206510 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-75b94dc6-316f-4ea0-a1c7-894aa5e7b682 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:04.289847 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-65d3150c-2bf1-4fbc-b195-4c5c0a53b8f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:04.290716 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-65d3150c-2bf1-4fbc-b195-4c5c0a53b8f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:04.297192 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-65d3150c-2bf1-4fbc-b195-4c5c0a53b8f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:04.297901 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-65d3150c-2bf1-4fbc-b195-4c5c0a53b8f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:04.298756 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-65d3150c-2bf1-4fbc-b195-4c5c0a53b8f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:04.299258 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-65d3150c-2bf1-4fbc-b195-4c5c0a53b8f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:04.344118 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-75b94dc6-316f-4ea0-a1c7-894aa5e7b682 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:04.352943 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-75b94dc6-316f-4ea0-a1c7-894aa5e7b682 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.158503 May 10 14:04:04.353831 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 279/587] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:04 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:04.433402 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-65d3150c-2bf1-4fbc-b195-4c5c0a53b8f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:04.440472 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-65d3150c-2bf1-4fbc-b195-4c5c0a53b8f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1367 microversion: 2.1 time: 0.155165 May 10 14:04:04.441046 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 309/588] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:04 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:04.989765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7438639c-f912-49d4-ab1c-0b8f1a51a2a8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:04.990399 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7438639c-f912-49d4-ab1c-0b8f1a51a2a8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:04.996813 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7438639c-f912-49d4-ab1c-0b8f1a51a2a8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:04.997208 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7438639c-f912-49d4-ab1c-0b8f1a51a2a8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:04.997984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7438639c-f912-49d4-ab1c-0b8f1a51a2a8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:04.998427 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7438639c-f912-49d4-ab1c-0b8f1a51a2a8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:05.128655 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7438639c-f912-49d4-ab1c-0b8f1a51a2a8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:05.136579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7438639c-f912-49d4-ab1c-0b8f1a51a2a8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1667 microversion: 2.1 time: 0.150616 May 10 14:04:05.137142 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 280/589] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:04 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:05.370242 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-07c07aa6-a511-404f-b803-04bed7197403 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:05.370894 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-07c07aa6-a511-404f-b803-04bed7197403 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:05.377922 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-07c07aa6-a511-404f-b803-04bed7197403 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:05.378376 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-07c07aa6-a511-404f-b803-04bed7197403 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:05.379157 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-07c07aa6-a511-404f-b803-04bed7197403 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:05.379602 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-07c07aa6-a511-404f-b803-04bed7197403 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:05.457587 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fb295796-a1fe-40c7-9015-7be24133d2f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:05.458240 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fb295796-a1fe-40c7-9015-7be24133d2f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:05.464549 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fb295796-a1fe-40c7-9015-7be24133d2f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:05.465047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fb295796-a1fe-40c7-9015-7be24133d2f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:05.465957 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fb295796-a1fe-40c7-9015-7be24133d2f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:05.466422 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fb295796-a1fe-40c7-9015-7be24133d2f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:05.510627 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-07c07aa6-a511-404f-b803-04bed7197403 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:05.518364 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-07c07aa6-a511-404f-b803-04bed7197403 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.152116 May 10 14:04:05.518940 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 310/590] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:05 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:05.591939 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-fb295796-a1fe-40c7-9015-7be24133d2f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:05.599261 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fb295796-a1fe-40c7-9015-7be24133d2f0 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1367 microversion: 2.1 time: 0.145557 May 10 14:04:05.599841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 281/591] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:05 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:06.331957 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-2b78d524-0fb0-4484-bf7e-13169092c1de req-717f36f0-912e-4b9a-b989-a62ffd1c0028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ade9bf-f1d4-454c-928b-bb882c680d30", "name": "network-vif-plugged", "status": "completed", "tag": "41e1a591-ff64-4acf-8e49-bb32771685e9"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:06.340628 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-2b78d524-0fb0-4484-bf7e-13169092c1de req-717f36f0-912e-4b9a-b989-a62ffd1c0028 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:06.341158 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-2b78d524-0fb0-4484-bf7e-13169092c1de req-717f36f0-912e-4b9a-b989-a62ffd1c0028 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:06.355320 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-2b78d524-0fb0-4484-bf7e-13169092c1de req-717f36f0-912e-4b9a-b989-a62ffd1c0028 service nova] Creating event network-vif-plugged:41e1a591-ff64-4acf-8e49-bb32771685e9 for instance 61ade9bf-f1d4-454c-928b-bb882c680d30 on hv-cinder-84067 May 10 14:04:06.360409 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-2b78d524-0fb0-4484-bf7e-13169092c1de req-717f36f0-912e-4b9a-b989-a62ffd1c0028 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032108 May 10 14:04:06.361007 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 311/592] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:06.535875 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-dbb463ff-c62a-4292-81e4-1d04d3ebd6c2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:06.536454 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-dbb463ff-c62a-4292-81e4-1d04d3ebd6c2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:06.543367 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dbb463ff-c62a-4292-81e4-1d04d3ebd6c2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:06.543819 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dbb463ff-c62a-4292-81e4-1d04d3ebd6c2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:06.544613 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dbb463ff-c62a-4292-81e4-1d04d3ebd6c2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:06.545047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dbb463ff-c62a-4292-81e4-1d04d3ebd6c2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:06.617314 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-28d69850-7652-4784-a5b0-e4cdb37eb00e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:06.618048 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-28d69850-7652-4784-a5b0-e4cdb37eb00e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:06.625300 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28d69850-7652-4784-a5b0-e4cdb37eb00e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:06.625756 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28d69850-7652-4784-a5b0-e4cdb37eb00e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:06.626536 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28d69850-7652-4784-a5b0-e4cdb37eb00e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:06.626977 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28d69850-7652-4784-a5b0-e4cdb37eb00e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:06.725365 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-dbb463ff-c62a-4292-81e4-1d04d3ebd6c2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:06.733786 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-dbb463ff-c62a-4292-81e4-1d04d3ebd6c2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.201840 May 10 14:04:06.734571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 282/593] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:06 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:06.758012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-28d69850-7652-4784-a5b0-e4cdb37eb00e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:06.765320 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-28d69850-7652-4784-a5b0-e4cdb37eb00e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1367 microversion: 2.1 time: 0.152781 May 10 14:04:06.765885 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 312/594] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:06 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:07.751601 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-573a2505-bb5c-4a56-92c2-b00949c31584 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:07.752113 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-573a2505-bb5c-4a56-92c2-b00949c31584 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:07.759155 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-573a2505-bb5c-4a56-92c2-b00949c31584 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:07.759604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-573a2505-bb5c-4a56-92c2-b00949c31584 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:07.760410 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-573a2505-bb5c-4a56-92c2-b00949c31584 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:07.760847 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-573a2505-bb5c-4a56-92c2-b00949c31584 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:07.782057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a186da11-2479-40bd-9e29-27735dde036a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:07.782771 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a186da11-2479-40bd-9e29-27735dde036a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:07.789060 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a186da11-2479-40bd-9e29-27735dde036a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:07.789515 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a186da11-2479-40bd-9e29-27735dde036a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:07.790290 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a186da11-2479-40bd-9e29-27735dde036a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:07.790729 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a186da11-2479-40bd-9e29-27735dde036a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:07.887518 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-573a2505-bb5c-4a56-92c2-b00949c31584 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:07.895494 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-573a2505-bb5c-4a56-92c2-b00949c31584 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.147593 May 10 14:04:07.896068 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 283/595] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:07 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:07.917619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a186da11-2479-40bd-9e29-27735dde036a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:07.924796 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a186da11-2479-40bd-9e29-27735dde036a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1367 microversion: 2.1 time: 0.146581 May 10 14:04:07.925363 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 313/596] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:07 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:08.915261 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2bf0bf85-078e-4b78-88bc-a3d22ebc7ae7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:08.915261 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2bf0bf85-078e-4b78-88bc-a3d22ebc7ae7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:08.924709 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2bf0bf85-078e-4b78-88bc-a3d22ebc7ae7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:08.925160 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2bf0bf85-078e-4b78-88bc-a3d22ebc7ae7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:08.925942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2bf0bf85-078e-4b78-88bc-a3d22ebc7ae7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:08.926380 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2bf0bf85-078e-4b78-88bc-a3d22ebc7ae7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:08.941385 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-66a9444b-0804-47da-9c22-df581ccd3021 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:08.942156 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-66a9444b-0804-47da-9c22-df581ccd3021 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:08.948502 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-66a9444b-0804-47da-9c22-df581ccd3021 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:08.948969 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-66a9444b-0804-47da-9c22-df581ccd3021 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:08.949729 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-66a9444b-0804-47da-9c22-df581ccd3021 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:08.950147 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-66a9444b-0804-47da-9c22-df581ccd3021 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:09.059374 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2bf0bf85-078e-4b78-88bc-a3d22ebc7ae7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:09.067218 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2bf0bf85-078e-4b78-88bc-a3d22ebc7ae7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.157765 May 10 14:04:09.067878 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 284/597] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:08 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:09.083732 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-66a9444b-0804-47da-9c22-df581ccd3021 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:09.090949 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-66a9444b-0804-47da-9c22-df581ccd3021 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1557 microversion: 2.1 time: 0.153395 May 10 14:04:09.091520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 314/598] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:08 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:09.107385 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bbe51d08-9626-4b33-82ff-0b02467b6e45 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:09.107877 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bbe51d08-9626-4b33-82ff-0b02467b6e45 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:09.113726 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbe51d08-9626-4b33-82ff-0b02467b6e45 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:09.114178 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbe51d08-9626-4b33-82ff-0b02467b6e45 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:09.114949 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbe51d08-9626-4b33-82ff-0b02467b6e45 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:09.115392 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbe51d08-9626-4b33-82ff-0b02467b6e45 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:09.190205 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bbe51d08-9626-4b33-82ff-0b02467b6e45 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086567 May 10 14:04:09.190845 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 285/599] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 14:04:09 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:10.084421 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f84add9a-1c88-4ea7-8540-c997f81b16ad tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:10.085205 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f84add9a-1c88-4ea7-8540-c997f81b16ad tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:10.091394 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f84add9a-1c88-4ea7-8540-c997f81b16ad tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.091907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f84add9a-1c88-4ea7-8540-c997f81b16ad tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.092773 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f84add9a-1c88-4ea7-8540-c997f81b16ad tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.093275 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f84add9a-1c88-4ea7-8540-c997f81b16ad tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.220043 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f84add9a-1c88-4ea7-8540-c997f81b16ad tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:10.227747 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f84add9a-1c88-4ea7-8540-c997f81b16ad tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.147196 May 10 14:04:10.228442 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 315/600] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:10 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:10.294248 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8307e4e6-59ec-41c2-9978-26074fdd5cd5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:10.294832 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8307e4e6-59ec-41c2-9978-26074fdd5cd5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:10.300906 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8307e4e6-59ec-41c2-9978-26074fdd5cd5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.301081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8307e4e6-59ec-41c2-9978-26074fdd5cd5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.301820 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8307e4e6-59ec-41c2-9978-26074fdd5cd5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.302254 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8307e4e6-59ec-41c2-9978-26074fdd5cd5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.330384 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8307e4e6-59ec-41c2-9978-26074fdd5cd5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/os-volume_attachments/b74c00c0-0f79-42d0-b621-ec754f20297d" status: 200 len: 194 microversion: 2.20 time: 0.040598 May 10 14:04:10.330974 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 286/601] 10.222.0.49 () {60 vars in 1453 bytes} [Tue May 10 14:04:10 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/os-volume_attachments/b74c00c0-0f79-42d0-b621-ec754f20297d => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:04:10.394540 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-7b9a0355-a85d-4ce3-ade9-790a7e57e220 req-fd0a9f52-2061-48fd-8de5-4ead2ed22b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ade9bf-f1d4-454c-928b-bb882c680d30", "tag": "41e1a591-ff64-4acf-8e49-bb32771685e9"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:10.402712 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a3ee0178-b77f-4acd-abe7-96ec3f851ee5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:10.403237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a3ee0178-b77f-4acd-abe7-96ec3f851ee5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:10.409414 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a3ee0178-b77f-4acd-abe7-96ec3f851ee5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.409875 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a3ee0178-b77f-4acd-abe7-96ec3f851ee5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.410503 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-7b9a0355-a85d-4ce3-ade9-790a7e57e220 req-fd0a9f52-2061-48fd-8de5-4ead2ed22b9c service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.410633 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a3ee0178-b77f-4acd-abe7-96ec3f851ee5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.410946 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-7b9a0355-a85d-4ce3-ade9-790a7e57e220 req-fd0a9f52-2061-48fd-8de5-4ead2ed22b9c service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.411117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a3ee0178-b77f-4acd-abe7-96ec3f851ee5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.423584 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-7b9a0355-a85d-4ce3-ade9-790a7e57e220 req-fd0a9f52-2061-48fd-8de5-4ead2ed22b9c service nova] Creating event network-changed:41e1a591-ff64-4acf-8e49-bb32771685e9 for instance 61ade9bf-f1d4-454c-928b-bb882c680d30 on hv-cinder-84067 May 10 14:04:10.428832 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-7b9a0355-a85d-4ce3-ade9-790a7e57e220 req-fd0a9f52-2061-48fd-8de5-4ead2ed22b9c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037812 May 10 14:04:10.430140 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 287/602] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:10.496067 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-a3ee0178-b77f-4acd-abe7-96ec3f851ee5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lazy-loading 'services' on Instance uuid 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:04:10.581019 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a3ee0178-b77f-4acd-abe7-96ec3f851ee5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "DELETE /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/os-volume_attachments/b74c00c0-0f79-42d0-b621-ec754f20297d" status: 202 len: 0 microversion: 2.20 time: 0.181970 May 10 14:04:10.581616 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 316/603] 10.222.0.49 () {60 vars in 1456 bytes} [Tue May 10 14:04:10 2022] DELETE /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/os-volume_attachments/b74c00c0-0f79-42d0-b621-ec754f20297d => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 14:04:10.590988 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ebebd88e-56fe-4a75-8ed9-2eaa235ab50c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:10.592037 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ebebd88e-56fe-4a75-8ed9-2eaa235ab50c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:10.598306 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ebebd88e-56fe-4a75-8ed9-2eaa235ab50c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.598757 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ebebd88e-56fe-4a75-8ed9-2eaa235ab50c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.599529 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ebebd88e-56fe-4a75-8ed9-2eaa235ab50c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.599963 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ebebd88e-56fe-4a75-8ed9-2eaa235ab50c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.630308 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ebebd88e-56fe-4a75-8ed9-2eaa235ab50c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043540 May 10 14:04:10.631209 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 288/604] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 14:04:10 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:04:11.245899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1793a9f5-50b8-452c-9b2b-386f23096347 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:11.247843 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1793a9f5-50b8-452c-9b2b-386f23096347 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:11.255103 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1793a9f5-50b8-452c-9b2b-386f23096347 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:11.255777 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1793a9f5-50b8-452c-9b2b-386f23096347 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:11.257351 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1793a9f5-50b8-452c-9b2b-386f23096347 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:11.257967 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1793a9f5-50b8-452c-9b2b-386f23096347 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:11.404215 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1793a9f5-50b8-452c-9b2b-386f23096347 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:11.412718 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1793a9f5-50b8-452c-9b2b-386f23096347 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.171520 May 10 14:04:11.413354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 317/605] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:11 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:11.643397 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b0811e79-025d-458a-ab36-7e2f1d01c869 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:11.644431 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b0811e79-025d-458a-ab36-7e2f1d01c869 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:11.653067 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b0811e79-025d-458a-ab36-7e2f1d01c869 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:11.653600 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b0811e79-025d-458a-ab36-7e2f1d01c869 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:11.654562 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b0811e79-025d-458a-ab36-7e2f1d01c869 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:11.654983 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b0811e79-025d-458a-ab36-7e2f1d01c869 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:11.684647 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b0811e79-025d-458a-ab36-7e2f1d01c869 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045871 May 10 14:04:11.685213 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 289/606] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 14:04:11 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:11.742242 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a0c07238-1b70-48c1-94dd-b69c5ce188e0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:11.742841 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a0c07238-1b70-48c1-94dd-b69c5ce188e0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:11.749017 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a0c07238-1b70-48c1-94dd-b69c5ce188e0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:11.749472 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a0c07238-1b70-48c1-94dd-b69c5ce188e0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:11.750248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a0c07238-1b70-48c1-94dd-b69c5ce188e0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:11.750685 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a0c07238-1b70-48c1-94dd-b69c5ce188e0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:11.776227 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a0c07238-1b70-48c1-94dd-b69c5ce188e0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Going to try to terminate instance {{(pid=117154) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:04:11.851898 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a0c07238-1b70-48c1-94dd-b69c5ce188e0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "DELETE /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 204 len: 0 microversion: 2.20 time: 0.113462 May 10 14:04:11.853030 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 318/607] 10.222.0.49 () {60 vars in 1279 bytes} [Tue May 10 14:04:11 2022] DELETE /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 14:04:11.861188 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2ae229f4-201f-44cc-bb3a-2c34846846c2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:11.861755 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2ae229f4-201f-44cc-bb3a-2c34846846c2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:11.868158 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2ae229f4-201f-44cc-bb3a-2c34846846c2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:11.868645 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2ae229f4-201f-44cc-bb3a-2c34846846c2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:11.869416 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2ae229f4-201f-44cc-bb3a-2c34846846c2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:11.869856 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2ae229f4-201f-44cc-bb3a-2c34846846c2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:11.999105 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2ae229f4-201f-44cc-bb3a-2c34846846c2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:12.006770 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2ae229f4-201f-44cc-bb3a-2c34846846c2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:12.008313 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2ae229f4-201f-44cc-bb3a-2c34846846c2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:12.009463 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2ae229f4-201f-44cc-bb3a-2c34846846c2 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.152448 May 10 14:04:12.010066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 290/608] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:11 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:04:12.430275 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-697e8277-2c2c-42ab-aaa9-6d648902c720 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:12.430980 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-697e8277-2c2c-42ab-aaa9-6d648902c720 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:12.437366 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-697e8277-2c2c-42ab-aaa9-6d648902c720 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:12.437822 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-697e8277-2c2c-42ab-aaa9-6d648902c720 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:12.438591 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-697e8277-2c2c-42ab-aaa9-6d648902c720 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:12.439034 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-697e8277-2c2c-42ab-aaa9-6d648902c720 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:12.571146 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-697e8277-2c2c-42ab-aaa9-6d648902c720 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:12.578772 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-697e8277-2c2c-42ab-aaa9-6d648902c720 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.152732 May 10 14:04:12.579343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 319/609] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:12 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:13.027913 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-74f7d6d8-955c-43ee-90d7-b2405c3a9ccb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:13.028581 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-74f7d6d8-955c-43ee-90d7-b2405c3a9ccb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:13.035133 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-74f7d6d8-955c-43ee-90d7-b2405c3a9ccb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:13.035585 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-74f7d6d8-955c-43ee-90d7-b2405c3a9ccb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:13.036383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-74f7d6d8-955c-43ee-90d7-b2405c3a9ccb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:13.036821 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-74f7d6d8-955c-43ee-90d7-b2405c3a9ccb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:13.165007 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-74f7d6d8-955c-43ee-90d7-b2405c3a9ccb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:13.172644 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-74f7d6d8-955c-43ee-90d7-b2405c3a9ccb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:13.174154 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-74f7d6d8-955c-43ee-90d7-b2405c3a9ccb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:13.175307 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-74f7d6d8-955c-43ee-90d7-b2405c3a9ccb tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1722 microversion: 2.20 time: 0.151249 May 10 14:04:13.175873 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 291/610] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:13 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:13.596585 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-28649c41-eeda-4251-8924-bd2011006d56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:13.597206 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-28649c41-eeda-4251-8924-bd2011006d56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:13.604041 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28649c41-eeda-4251-8924-bd2011006d56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:13.604521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28649c41-eeda-4251-8924-bd2011006d56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:13.605296 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28649c41-eeda-4251-8924-bd2011006d56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:13.605744 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-28649c41-eeda-4251-8924-bd2011006d56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:13.732711 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-28649c41-eeda-4251-8924-bd2011006d56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:13.740445 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-28649c41-eeda-4251-8924-bd2011006d56 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.147686 May 10 14:04:13.741024 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 320/611] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:13 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:14.193289 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d0624ac2-0013-4b50-81d0-6ab56cb78e32 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:14.193935 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d0624ac2-0013-4b50-81d0-6ab56cb78e32 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:14.200674 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d0624ac2-0013-4b50-81d0-6ab56cb78e32 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:14.201121 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d0624ac2-0013-4b50-81d0-6ab56cb78e32 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:14.201890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d0624ac2-0013-4b50-81d0-6ab56cb78e32 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:14.202324 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d0624ac2-0013-4b50-81d0-6ab56cb78e32 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:14.299130 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d0624ac2-0013-4b50-81d0-6ab56cb78e32 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:14.308903 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d0624ac2-0013-4b50-81d0-6ab56cb78e32 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:14.310504 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d0624ac2-0013-4b50-81d0-6ab56cb78e32 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:14.311673 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d0624ac2-0013-4b50-81d0-6ab56cb78e32 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1655 microversion: 2.20 time: 0.122325 May 10 14:04:14.312308 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 292/612] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:14 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1655 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:14.586368 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-f2e3e865-2ff2-4426-aa98-a83e4ee8dc9b req-4a7f4806-f22c-42dd-84c3-48ba740ca4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067bd8aa-a9d7-41f4-82a3-54e00fe64f68", "name": "network-vif-deleted", "tag": "0b32a17e-9e2f-475d-abe1-8b69acb4c76a"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:14.595366 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-f2e3e865-2ff2-4426-aa98-a83e4ee8dc9b req-4a7f4806-f22c-42dd-84c3-48ba740ca4c9 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:14.595814 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-f2e3e865-2ff2-4426-aa98-a83e4ee8dc9b req-4a7f4806-f22c-42dd-84c3-48ba740ca4c9 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:14.612867 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-f2e3e865-2ff2-4426-aa98-a83e4ee8dc9b req-4a7f4806-f22c-42dd-84c3-48ba740ca4c9 service nova] Creating event network-vif-deleted:0b32a17e-9e2f-475d-abe1-8b69acb4c76a for instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 on hv-cinder-84067 May 10 14:04:14.618569 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-f2e3e865-2ff2-4426-aa98-a83e4ee8dc9b req-4a7f4806-f22c-42dd-84c3-48ba740ca4c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036175 May 10 14:04:14.619760 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 321/613] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:14.757633 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a0deb319-53b1-486a-946f-171198ac25a6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:14.758293 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a0deb319-53b1-486a-946f-171198ac25a6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:14.773717 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a0deb319-53b1-486a-946f-171198ac25a6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:14.776005 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a0deb319-53b1-486a-946f-171198ac25a6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:14.776850 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a0deb319-53b1-486a-946f-171198ac25a6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:14.777322 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a0deb319-53b1-486a-946f-171198ac25a6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:14.935509 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a0deb319-53b1-486a-946f-171198ac25a6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:14.943417 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a0deb319-53b1-486a-946f-171198ac25a6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.189720 May 10 14:04:14.944000 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 293/614] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:14 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:15.330776 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:15.331485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:15.338227 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:15.338675 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:15.339469 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:15.339904 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:15.372735 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:15.373190 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:15.373643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lazy-loading 'fault' on Instance uuid 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:04:15.418840 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:15.427055 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:15.429575 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:15.430758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-85cd3f9b-9a87-4ddd-90e2-f727c0b02582 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 200 len: 1371 microversion: 2.20 time: 0.104375 May 10 14:04:15.431350 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 322/615] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:15 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:15.961670 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-55a04279-10a9-4107-8fc1-2f8debad7567 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:15.962272 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-55a04279-10a9-4107-8fc1-2f8debad7567 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:15.968628 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-55a04279-10a9-4107-8fc1-2f8debad7567 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:15.969070 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-55a04279-10a9-4107-8fc1-2f8debad7567 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:15.969831 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-55a04279-10a9-4107-8fc1-2f8debad7567 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:15.970262 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-55a04279-10a9-4107-8fc1-2f8debad7567 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:16.099558 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-55a04279-10a9-4107-8fc1-2f8debad7567 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:16.107200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-55a04279-10a9-4107-8fc1-2f8debad7567 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.149869 May 10 14:04:16.107762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 294/616] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:15 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:16.448911 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-69f0c292-8cea-47c7-9f0a-817a08b09547 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:16.449612 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-69f0c292-8cea-47c7-9f0a-817a08b09547 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:16.455793 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-69f0c292-8cea-47c7-9f0a-817a08b09547 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:16.456301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-69f0c292-8cea-47c7-9f0a-817a08b09547 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:16.457073 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-69f0c292-8cea-47c7-9f0a-817a08b09547 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:16.457486 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-69f0c292-8cea-47c7-9f0a-817a08b09547 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:16.472368 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-69f0c292-8cea-47c7-9f0a-817a08b09547 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] HTTP exception thrown: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-69f0c292-8cea-47c7-9f0a-817a08b09547 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Request method failure captured: May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 HTTP/1.1 May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_s75McvgWhPruNL1rqCZYcJx0qi1L1AZfbVPbZ-4Kr9rTtMueP7uUYxVYHCTgjW3Pjz-S2f9ymiA-VANjfjFPqE9_vyYAFkNnckOBVsFToAmU_HnpnSu65_TAZwTKt0HLMTMUvTjzS5OM91Xl4n-9BAgKku4ZBfKrwxbFhPZe1XWE May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: dd39c2a00ace4575896bf3f045bedce1 May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:04:16.474005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:04:16.476238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:04:16.476238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:04:16.476238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: dd39c2a00ace4575896bf3f045bedce1 May 10 14:04:16.476238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:04:16.476238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeShelveTestJSON-1426318459-project May 10 14:04:16.476238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:04:16.476238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:04:16.476238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 67535c1c99484689999ef478604e51d0 May 10 14:04:16.476238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1426318459-project May 10 14:04:16.476238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:04:16.476238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:04:16.476238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '067bd8aa-a9d7-41f4-82a3-54e00fe64f68'} May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:04:16.477117 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:04:16.479625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:04:16.482141 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-69f0c292-8cea-47c7-9f0a-817a08b09547 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Returning 404 to user: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:04:16.482141 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-69f0c292-8cea-47c7-9f0a-817a08b09547 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 404 len: 111 microversion: 2.20 time: 0.034198 May 10 14:04:16.482141 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 323/617] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:16 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:04:16.488440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3ad6efc6-a7d9-4eef-acdb-5341efcb7e5a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '.version_select at 0x7f5f7c07a040>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:16.507927 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3ad6efc6-a7d9-4eef-acdb-5341efcb7e5a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470184906" status: 204 len: 0 microversion: 2.20 time: 0.023329 May 10 14:04:16.508649 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 295/618] 10.222.0.49 () {60 vars in 1261 bytes} [Tue May 10 14:04:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470184906 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 14:04:17.125100 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-88e02c09-ef18-457b-94c0-80b2137b05f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:17.125707 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-88e02c09-ef18-457b-94c0-80b2137b05f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:17.131811 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-88e02c09-ef18-457b-94c0-80b2137b05f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:17.132482 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-88e02c09-ef18-457b-94c0-80b2137b05f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:17.135005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-88e02c09-ef18-457b-94c0-80b2137b05f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:17.135005 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-88e02c09-ef18-457b-94c0-80b2137b05f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:17.142331 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bff7f7f1-ed2f-4f89-9e51-90a86015b8b0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Action: 'create', calling method: .version_select at 0x7f5f7c1c9040>, body: {"keypair": {"name": "tempest-keypair-1287782749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEX3MaWFIhDaCEbFDt9NUabwQb73LNre5d8w237JmjCmANgIJ4TxkX2iMnSMLSxlK96K+tptqkbs4H/DSOUjv0KLZumTWeQRkYyQfFpasWhOewK49E+8nQRsq9Kv1GwkrA=="}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:17.156710 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-bff7f7f1-ed2f-4f89-9e51-90a86015b8b0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Getting quotas for project dd39c2a00ace4575896bf3f045bedce1. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:04:17.161239 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-bff7f7f1-ed2f-4f89-9e51-90a86015b8b0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Getting quotas for user 67535c1c99484689999ef478604e51d0 and project dd39c2a00ace4575896bf3f045bedce1. Resources: {'key_pairs'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:04:17.187766 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bff7f7f1-ed2f-4f89-9e51-90a86015b8b0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049484 May 10 14:04:17.188571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 296/619] 10.222.0.49 () {62 vars in 1199 bytes} [Tue May 10 14:04:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 10 14:04:17.270514 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-88e02c09-ef18-457b-94c0-80b2137b05f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:17.278292 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-88e02c09-ef18-457b-94c0-80b2137b05f7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1734 microversion: 2.1 time: 0.157032 May 10 14:04:17.278870 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 324/620] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:17 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:18.296762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f583ffe2-cb43-49fd-9f69-2c245e875091 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:18.297939 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f583ffe2-cb43-49fd-9f69-2c245e875091 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:18.305243 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f583ffe2-cb43-49fd-9f69-2c245e875091 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:18.305695 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f583ffe2-cb43-49fd-9f69-2c245e875091 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:18.306581 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f583ffe2-cb43-49fd-9f69-2c245e875091 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:18.307022 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f583ffe2-cb43-49fd-9f69-2c245e875091 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:18.420296 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1133988008", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c2e159f-7eb2-470d-9799-bf81a94b9b35"}], "security_groups": [{"name": "tempest-securitygroup--230036600"}], "key_name": "tempest-keypair-1287782749", "user_data": "}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:18.444296 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f583ffe2-cb43-49fd-9f69-2c245e875091 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:18.451956 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f583ffe2-cb43-49fd-9f69-2c245e875091 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1714 microversion: 2.1 time: 0.159584 May 10 14:04:18.452678 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 297/621] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:18 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:18.522632 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] validate_networks() for [('9c2e159f-7eb2-470d-9799-bf81a94b9b35', None, None, None, None, None)] {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:04:18.554472 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-931ce3f2-cc36-436a-b861-67c9b29a12bc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:18.554968 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-931ce3f2-cc36-436a-b861-67c9b29a12bc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:18.560979 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-931ce3f2-cc36-436a-b861-67c9b29a12bc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:18.561434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-931ce3f2-cc36-436a-b861-67c9b29a12bc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:18.562242 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-931ce3f2-cc36-436a-b861-67c9b29a12bc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:18.562687 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-931ce3f2-cc36-436a-b861-67c9b29a12bc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:18.641368 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-931ce3f2-cc36-436a-b861-67c9b29a12bc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] HTTP exception thrown: Cannot 'detach_volume' instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a while it is in vm_state rescued May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-931ce3f2-cc36-436a-b861-67c9b29a12bc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Request method failure captured: May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: DELETE /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments/6e2e3ed9-e4df-4cde-b96b-ab6c909a1e3b HTTP/1.1 May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_xDu6JK8pwUvXha8KU8vHpKnPJ5AHhm1By_XEE5j72JnoFzaYxegH6ZsuxN4FWA1raNtM_ROxaWfY0nbamU8BT7VWF1Y7WMNmjHep8IOoIxRuQKI3XGxdDGrNRZkarxHVxP2Sbt7uY3g2tkENQuSC7H9HTviVk1BNO3aP-ni1o7Qs May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 368287ad726146f88559c73a86e4b26d May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:04:18.642984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:04:18.644316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/368287ad726146f88559c73a86e4b26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_368287ad726146f88559c73a86e4b26d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/368287ad726146f88559c73a86e4b26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/368287ad726146f88559c73a86e4b26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:04:18.644316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:04:18.644316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 368287ad726146f88559c73a86e4b26d May 10 14:04:18.644316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:04:18.644316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-ServerRescueNegativeTestJSON-1855127385-project May 10 14:04:18.644316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:04:18.644316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:04:18.644316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: bd14de0fd51c4fd89d9875b9c47100cc May 10 14:04:18.644316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855127385-project May 10 14:04:18.644316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:04:18.644316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Cannot 'detach_volume' instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a while it is in vm_state rescued May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'server_id': '2a730d46-5e87-4a26-a9fc-4486e99bcf5a', 'id': '6e2e3ed9-e4df-4cde-b96b-ab6c909a1e3b'} May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:04:18.645252 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a while it is in vm_state rescued May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a while it is in vm_state rescued May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:18.646891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-931ce3f2-cc36-436a-b861-67c9b29a12bc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Returning 409 to user: Cannot 'detach_volume' instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a while it is in vm_state rescued {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:04:18.648964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-931ce3f2-cc36-436a-b861-67c9b29a12bc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments/6e2e3ed9-e4df-4cde-b96b-ab6c909a1e3b" status: 409 len: 152 microversion: 2.1 time: 0.094132 May 10 14:04:18.648964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 298/622] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 14:04:18 2022] DELETE /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments/6e2e3ed9-e4df-4cde-b96b-ab6c909a1e3b => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 10 14:04:18.653815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5552aeb1-2a5d-47e8-b856-ce631bbdc8be tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:18.654342 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-5552aeb1-2a5d-47e8-b856-ce631bbdc8be tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:18.660264 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5552aeb1-2a5d-47e8-b856-ce631bbdc8be tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:18.660748 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5552aeb1-2a5d-47e8-b856-ce631bbdc8be tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:18.661522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5552aeb1-2a5d-47e8-b856-ce631bbdc8be tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:18.661960 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5552aeb1-2a5d-47e8-b856-ce631bbdc8be tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:18.727306 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-5552aeb1-2a5d-47e8-b856-ce631bbdc8be tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "POST /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/action" status: 202 len: 0 microversion: 2.1 time: 0.076899 May 10 14:04:18.728446 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 299/623] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:04:18 2022] POST /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:04:18.737881 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c41c7f4b-7e26-4ff8-b6cb-e0325d4c25d8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:18.738579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c41c7f4b-7e26-4ff8-b6cb-e0325d4c25d8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:18.745578 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c41c7f4b-7e26-4ff8-b6cb-e0325d4c25d8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:18.746034 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c41c7f4b-7e26-4ff8-b6cb-e0325d4c25d8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:18.746875 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c41c7f4b-7e26-4ff8-b6cb-e0325d4c25d8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:18.747371 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c41c7f4b-7e26-4ff8-b6cb-e0325d4c25d8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:18.888776 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:04:18.889204 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:04:18.890336 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:04:18.890760 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:04:18.891212 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:04:18.901698 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:18.902935 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:18.904297 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:18.904957 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:18.921813 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Getting quotas for project dd39c2a00ace4575896bf3f045bedce1. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:04:18.925761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Getting quotas for user 67535c1c99484689999ef478604e51d0 and project dd39c2a00ace4575896bf3f045bedce1. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:04:18.937239 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:04:18.939483 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:04:18.955556 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c41c7f4b-7e26-4ff8-b6cb-e0325d4c25d8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:18.963411 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c41c7f4b-7e26-4ff8-b6cb-e0325d4c25d8 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1722 microversion: 2.1 time: 0.230899 May 10 14:04:18.964201 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 300/624] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:18 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:18.990432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-60a59ea6-66bb-4c12-a24c-c3517f47f78d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.574249 May 10 14:04:18.991714 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 325/625] 10.222.0.49 () {62 vars in 1187 bytes} [Tue May 10 14:04:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 10 14:04:19.001516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3f6acefb-a2f1-4c0e-b026-9a5d46b4da15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:19.002054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-3f6acefb-a2f1-4c0e-b026-9a5d46b4da15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:19.082173 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3f6acefb-a2f1-4c0e-b026-9a5d46b4da15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:19.090374 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3f6acefb-a2f1-4c0e-b026-9a5d46b4da15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:19.092264 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3f6acefb-a2f1-4c0e-b026-9a5d46b4da15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:19.093376 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3f6acefb-a2f1-4c0e-b026-9a5d46b4da15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1282 microversion: 2.20 time: 0.095826 May 10 14:04:19.094971 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 301/626] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:18 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:19.981149 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d91cdb01-9319-44c0-a61a-8933c67d3695 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:19.981761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d91cdb01-9319-44c0-a61a-8933c67d3695 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:19.987661 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d91cdb01-9319-44c0-a61a-8933c67d3695 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:19.988110 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d91cdb01-9319-44c0-a61a-8933c67d3695 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:19.988899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d91cdb01-9319-44c0-a61a-8933c67d3695 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:19.989332 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d91cdb01-9319-44c0-a61a-8933c67d3695 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:20.112781 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2537ff30-3edb-479a-97f7-15b6ed826268 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:20.113388 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2537ff30-3edb-479a-97f7-15b6ed826268 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:20.119816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d91cdb01-9319-44c0-a61a-8933c67d3695 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:20.121163 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2537ff30-3edb-479a-97f7-15b6ed826268 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:20.121621 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2537ff30-3edb-479a-97f7-15b6ed826268 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:20.122406 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2537ff30-3edb-479a-97f7-15b6ed826268 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:20.122851 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2537ff30-3edb-479a-97f7-15b6ed826268 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:20.128249 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d91cdb01-9319-44c0-a61a-8933c67d3695 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1722 microversion: 2.1 time: 0.151328 May 10 14:04:20.129246 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 326/627] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:19 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:20.187358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2537ff30-3edb-479a-97f7-15b6ed826268 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:20.195011 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2537ff30-3edb-479a-97f7-15b6ed826268 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:20.196565 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2537ff30-3edb-479a-97f7-15b6ed826268 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:20.197660 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2537ff30-3edb-479a-97f7-15b6ed826268 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1334 microversion: 2.20 time: 0.088794 May 10 14:04:20.198222 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 302/628] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:20 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:04:21.148969 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-486218a1-627c-48c5-9117-41239b2f46ab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:21.149590 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-486218a1-627c-48c5-9117-41239b2f46ab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:21.156363 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-486218a1-627c-48c5-9117-41239b2f46ab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:21.156814 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-486218a1-627c-48c5-9117-41239b2f46ab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:21.157598 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-486218a1-627c-48c5-9117-41239b2f46ab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:21.158054 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-486218a1-627c-48c5-9117-41239b2f46ab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:21.215532 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-84cf1e5f-a774-4bc3-bffb-067c233b7535 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:21.216131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-84cf1e5f-a774-4bc3-bffb-067c233b7535 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:21.222569 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-84cf1e5f-a774-4bc3-bffb-067c233b7535 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:21.223015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-84cf1e5f-a774-4bc3-bffb-067c233b7535 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:21.223777 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-84cf1e5f-a774-4bc3-bffb-067c233b7535 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:21.224246 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-84cf1e5f-a774-4bc3-bffb-067c233b7535 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:21.284323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-84cf1e5f-a774-4bc3-bffb-067c233b7535 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:21.289773 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-486218a1-627c-48c5-9117-41239b2f46ab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:21.292613 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-84cf1e5f-a774-4bc3-bffb-067c233b7535 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:21.294265 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-84cf1e5f-a774-4bc3-bffb-067c233b7535 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:21.295356 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-84cf1e5f-a774-4bc3-bffb-067c233b7535 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1334 microversion: 2.20 time: 0.083750 May 10 14:04:21.295916 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 303/629] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:21 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1334 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:04:21.297556 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-486218a1-627c-48c5-9117-41239b2f46ab tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1722 microversion: 2.1 time: 0.155189 May 10 14:04:21.298125 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 327/630] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:21 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:22.313853 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b6f97284-0d67-42d8-9221-8c45d150c9a9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:22.314441 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-31c2e253-34b3-4dcc-b53c-32d8e7727560 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:22.314833 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b6f97284-0d67-42d8-9221-8c45d150c9a9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:22.315034 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-31c2e253-34b3-4dcc-b53c-32d8e7727560 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:22.321410 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6f97284-0d67-42d8-9221-8c45d150c9a9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:22.321739 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-31c2e253-34b3-4dcc-b53c-32d8e7727560 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:22.321876 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6f97284-0d67-42d8-9221-8c45d150c9a9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:22.322196 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-31c2e253-34b3-4dcc-b53c-32d8e7727560 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:22.322622 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6f97284-0d67-42d8-9221-8c45d150c9a9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:22.322968 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-31c2e253-34b3-4dcc-b53c-32d8e7727560 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:22.323084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6f97284-0d67-42d8-9221-8c45d150c9a9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:22.323413 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-31c2e253-34b3-4dcc-b53c-32d8e7727560 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:22.392709 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b6f97284-0d67-42d8-9221-8c45d150c9a9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:22.398082 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b6f97284-0d67-42d8-9221-8c45d150c9a9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:22.399620 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b6f97284-0d67-42d8-9221-8c45d150c9a9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:22.400781 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b6f97284-0d67-42d8-9221-8c45d150c9a9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1342 microversion: 2.20 time: 0.090849 May 10 14:04:22.401722 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 304/631] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:22 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:22.469407 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-31c2e253-34b3-4dcc-b53c-32d8e7727560 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:22.478143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-31c2e253-34b3-4dcc-b53c-32d8e7727560 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1728 microversion: 2.1 time: 0.167437 May 10 14:04:22.479342 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 328/632] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:22 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:22.494864 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b10d9a38-40da-4646-ba96-f4f6b1ea4d0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:22.495350 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b10d9a38-40da-4646-ba96-f4f6b1ea4d0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:22.501848 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b10d9a38-40da-4646-ba96-f4f6b1ea4d0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:22.502299 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b10d9a38-40da-4646-ba96-f4f6b1ea4d0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:22.503087 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b10d9a38-40da-4646-ba96-f4f6b1ea4d0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:22.503527 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b10d9a38-40da-4646-ba96-f4f6b1ea4d0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:22.600276 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b10d9a38-40da-4646-ba96-f4f6b1ea4d0f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109334 May 10 14:04:22.601009 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 305/633] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 14:04:22 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:23.419335 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-83b7f470-372f-4973-9d23-b5d383d48278 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:23.420562 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-83b7f470-372f-4973-9d23-b5d383d48278 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:23.429855 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-83b7f470-372f-4973-9d23-b5d383d48278 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:23.430523 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-83b7f470-372f-4973-9d23-b5d383d48278 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:23.431291 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-83b7f470-372f-4973-9d23-b5d383d48278 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:23.433522 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-83b7f470-372f-4973-9d23-b5d383d48278 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:23.658169 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-83b7f470-372f-4973-9d23-b5d383d48278 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:23.669118 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-83b7f470-372f-4973-9d23-b5d383d48278 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:23.670834 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-83b7f470-372f-4973-9d23-b5d383d48278 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:23.671948 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-83b7f470-372f-4973-9d23-b5d383d48278 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1407 microversion: 2.20 time: 0.256461 May 10 14:04:23.672725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 329/634] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:23 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:23.876860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-8b1d4eb4-85fd-4172-a688-b06bc7522a6d req-7df8a9de-320e-4556-9dd0-569b802cb74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a730d46-5e87-4a26-a9fc-4486e99bcf5a", "tag": "f2587919-e230-4e3a-8926-a6478337a26a"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:23.896846 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-8b1d4eb4-85fd-4172-a688-b06bc7522a6d req-7df8a9de-320e-4556-9dd0-569b802cb74d service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:23.897913 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-8b1d4eb4-85fd-4172-a688-b06bc7522a6d req-7df8a9de-320e-4556-9dd0-569b802cb74d service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:23.914876 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-8b1d4eb4-85fd-4172-a688-b06bc7522a6d req-7df8a9de-320e-4556-9dd0-569b802cb74d service nova] Creating event network-changed:f2587919-e230-4e3a-8926-a6478337a26a for instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a on hv-cinder-84067 May 10 14:04:23.920773 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-8b1d4eb4-85fd-4172-a688-b06bc7522a6d req-7df8a9de-320e-4556-9dd0-569b802cb74d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047342 May 10 14:04:23.925647 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 306/635] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:24.323727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-2efa8bb4-527e-4f20-9cc6-f6e3c0e41e6c req-bab4cb8c-4b45-4a75-9eb0-29e2d42b1fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e6e847-c76f-441e-a7f8-63251b198a2d", "tag": "7c7e5879-9276-48c6-9f02-0be4571c330e"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:24.344091 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-2efa8bb4-527e-4f20-9cc6-f6e3c0e41e6c req-bab4cb8c-4b45-4a75-9eb0-29e2d42b1fc7 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:24.345850 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-2efa8bb4-527e-4f20-9cc6-f6e3c0e41e6c req-bab4cb8c-4b45-4a75-9eb0-29e2d42b1fc7 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:24.359608 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-2efa8bb4-527e-4f20-9cc6-f6e3c0e41e6c req-bab4cb8c-4b45-4a75-9eb0-29e2d42b1fc7 service nova] Creating event network-changed:7c7e5879-9276-48c6-9f02-0be4571c330e for instance 18e6e847-c76f-441e-a7f8-63251b198a2d on hv-cinder-84067 May 10 14:04:24.368574 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-2efa8bb4-527e-4f20-9cc6-f6e3c0e41e6c req-bab4cb8c-4b45-4a75-9eb0-29e2d42b1fc7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051807 May 10 14:04:24.369528 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 330/636] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:24.691247 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ab0e7895-ff5b-41b9-904d-d709a67c494f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:24.691879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ab0e7895-ff5b-41b9-904d-d709a67c494f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:24.699223 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ab0e7895-ff5b-41b9-904d-d709a67c494f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:24.699829 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ab0e7895-ff5b-41b9-904d-d709a67c494f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:24.701382 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ab0e7895-ff5b-41b9-904d-d709a67c494f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:24.701961 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ab0e7895-ff5b-41b9-904d-d709a67c494f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:25.028290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ab0e7895-ff5b-41b9-904d-d709a67c494f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:25.036210 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ab0e7895-ff5b-41b9-904d-d709a67c494f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:25.038335 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ab0e7895-ff5b-41b9-904d-d709a67c494f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:25.039715 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ab0e7895-ff5b-41b9-904d-d709a67c494f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1407 microversion: 2.20 time: 0.352917 May 10 14:04:25.050427 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 307/637] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:24 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:25.936772 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-ec203822-d021-481f-ae08-9864f91245e4 req-ec86d99a-594f-4d43-845b-0bef3588bb2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a730d46-5e87-4a26-a9fc-4486e99bcf5a", "tag": "f2587919-e230-4e3a-8926-a6478337a26a"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:25.945845 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-ec203822-d021-481f-ae08-9864f91245e4 req-ec86d99a-594f-4d43-845b-0bef3588bb2b service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:25.946284 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-ec203822-d021-481f-ae08-9864f91245e4 req-ec86d99a-594f-4d43-845b-0bef3588bb2b service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:25.958443 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-ec203822-d021-481f-ae08-9864f91245e4 req-ec86d99a-594f-4d43-845b-0bef3588bb2b service nova] Creating event network-changed:f2587919-e230-4e3a-8926-a6478337a26a for instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a on hv-cinder-84067 May 10 14:04:25.963282 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-ec203822-d021-481f-ae08-9864f91245e4 req-ec86d99a-594f-4d43-845b-0bef3588bb2b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030467 May 10 14:04:25.963857 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 331/638] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:26.057750 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1980d59f-0dc8-46d9-be85-6783d0027538 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:26.058358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1980d59f-0dc8-46d9-be85-6783d0027538 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:26.064661 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1980d59f-0dc8-46d9-be85-6783d0027538 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:26.065115 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1980d59f-0dc8-46d9-be85-6783d0027538 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:26.065886 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1980d59f-0dc8-46d9-be85-6783d0027538 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:26.066327 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1980d59f-0dc8-46d9-be85-6783d0027538 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:26.200240 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1980d59f-0dc8-46d9-be85-6783d0027538 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:26.210860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1980d59f-0dc8-46d9-be85-6783d0027538 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:26.212408 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1980d59f-0dc8-46d9-be85-6783d0027538 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:26.215176 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1980d59f-0dc8-46d9-be85-6783d0027538 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1407 microversion: 2.20 time: 0.161277 May 10 14:04:26.215750 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 308/639] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:26 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:27.236612 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-98189b45-3fa2-47db-9e61-38413bb3cb5c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:27.237233 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-98189b45-3fa2-47db-9e61-38413bb3cb5c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:27.243682 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-98189b45-3fa2-47db-9e61-38413bb3cb5c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:27.244136 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-98189b45-3fa2-47db-9e61-38413bb3cb5c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:27.244925 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-98189b45-3fa2-47db-9e61-38413bb3cb5c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:27.245363 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-98189b45-3fa2-47db-9e61-38413bb3cb5c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:27.373848 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-98189b45-3fa2-47db-9e61-38413bb3cb5c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:27.381704 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-98189b45-3fa2-47db-9e61-38413bb3cb5c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:27.383207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-98189b45-3fa2-47db-9e61-38413bb3cb5c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:27.384352 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-98189b45-3fa2-47db-9e61-38413bb3cb5c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1407 microversion: 2.20 time: 0.152538 May 10 14:04:27.384921 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 332/640] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:27 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:28.402958 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-43d761d4-e368-4247-b145-178e1bf629a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:28.403682 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-43d761d4-e368-4247-b145-178e1bf629a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:28.410136 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-43d761d4-e368-4247-b145-178e1bf629a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:28.410588 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-43d761d4-e368-4247-b145-178e1bf629a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:28.411492 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-43d761d4-e368-4247-b145-178e1bf629a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:28.411931 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-43d761d4-e368-4247-b145-178e1bf629a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:28.544651 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-43d761d4-e368-4247-b145-178e1bf629a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:28.551354 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-43d761d4-e368-4247-b145-178e1bf629a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:28.552905 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-43d761d4-e368-4247-b145-178e1bf629a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:28.554561 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-43d761d4-e368-4247-b145-178e1bf629a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1407 microversion: 2.20 time: 0.155879 May 10 14:04:28.555124 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 309/641] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:28 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:29.573045 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1fecf954-e970-453e-975d-56cadf4d1799 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:29.573647 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1fecf954-e970-453e-975d-56cadf4d1799 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:29.579918 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1fecf954-e970-453e-975d-56cadf4d1799 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:29.580400 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1fecf954-e970-453e-975d-56cadf4d1799 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:29.581153 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1fecf954-e970-453e-975d-56cadf4d1799 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:29.581583 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1fecf954-e970-453e-975d-56cadf4d1799 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:29.705786 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1fecf954-e970-453e-975d-56cadf4d1799 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:29.713817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1fecf954-e970-453e-975d-56cadf4d1799 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:29.715321 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1fecf954-e970-453e-975d-56cadf4d1799 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:29.716445 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1fecf954-e970-453e-975d-56cadf4d1799 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1407 microversion: 2.20 time: 0.147888 May 10 14:04:29.717014 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 333/642] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:29 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:30.465140 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-b4b76b56-626b-4737-9bb6-bcacb5db7864 req-33d51e87-900b-40e1-af87-2b1c58f02a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e6e847-c76f-441e-a7f8-63251b198a2d", "name": "network-vif-plugged", "status": "completed", "tag": "7c7e5879-9276-48c6-9f02-0be4571c330e"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:30.474611 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-b4b76b56-626b-4737-9bb6-bcacb5db7864 req-33d51e87-900b-40e1-af87-2b1c58f02a20 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:30.476178 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-b4b76b56-626b-4737-9bb6-bcacb5db7864 req-33d51e87-900b-40e1-af87-2b1c58f02a20 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:30.487430 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-b4b76b56-626b-4737-9bb6-bcacb5db7864 req-33d51e87-900b-40e1-af87-2b1c58f02a20 service nova] Creating event network-vif-plugged:7c7e5879-9276-48c6-9f02-0be4571c330e for instance 18e6e847-c76f-441e-a7f8-63251b198a2d on hv-cinder-84067 May 10 14:04:30.493663 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-b4b76b56-626b-4737-9bb6-bcacb5db7864 req-33d51e87-900b-40e1-af87-2b1c58f02a20 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032082 May 10 14:04:30.494255 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 310/643] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:30.733744 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-07e29b26-f324-4e22-a953-26a618ddad9f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:30.734343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-07e29b26-f324-4e22-a953-26a618ddad9f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:30.747139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-07e29b26-f324-4e22-a953-26a618ddad9f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:30.747586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-07e29b26-f324-4e22-a953-26a618ddad9f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:30.748516 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-07e29b26-f324-4e22-a953-26a618ddad9f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:30.749167 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-07e29b26-f324-4e22-a953-26a618ddad9f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:30.878109 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-07e29b26-f324-4e22-a953-26a618ddad9f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:30.886683 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-07e29b26-f324-4e22-a953-26a618ddad9f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:30.888184 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-07e29b26-f324-4e22-a953-26a618ddad9f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:30.889284 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-07e29b26-f324-4e22-a953-26a618ddad9f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1407 microversion: 2.20 time: 0.159402 May 10 14:04:30.889847 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 334/644] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:30 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:31.908490 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-97dcb7e1-4cab-4c74-8e4f-945023e8ff66 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:31.909190 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-97dcb7e1-4cab-4c74-8e4f-945023e8ff66 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:31.915798 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-97dcb7e1-4cab-4c74-8e4f-945023e8ff66 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:31.916288 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-97dcb7e1-4cab-4c74-8e4f-945023e8ff66 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:31.917067 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-97dcb7e1-4cab-4c74-8e4f-945023e8ff66 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:31.917517 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-97dcb7e1-4cab-4c74-8e4f-945023e8ff66 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:32.047570 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-97dcb7e1-4cab-4c74-8e4f-945023e8ff66 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:32.055897 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-97dcb7e1-4cab-4c74-8e4f-945023e8ff66 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:32.057448 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-97dcb7e1-4cab-4c74-8e4f-945023e8ff66 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:32.058553 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-97dcb7e1-4cab-4c74-8e4f-945023e8ff66 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1407 microversion: 2.20 time: 0.154389 May 10 14:04:32.059117 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 311/645] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:31 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:33.076894 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a42f299b-1530-41e6-a7e2-32b4e2b5e4fe tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:33.077505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a42f299b-1530-41e6-a7e2-32b4e2b5e4fe tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:33.083795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a42f299b-1530-41e6-a7e2-32b4e2b5e4fe tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:33.084853 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a42f299b-1530-41e6-a7e2-32b4e2b5e4fe tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:33.085620 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a42f299b-1530-41e6-a7e2-32b4e2b5e4fe tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:33.086071 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a42f299b-1530-41e6-a7e2-32b4e2b5e4fe tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:33.210754 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a42f299b-1530-41e6-a7e2-32b4e2b5e4fe tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:33.218873 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a42f299b-1530-41e6-a7e2-32b4e2b5e4fe tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:33.220397 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a42f299b-1530-41e6-a7e2-32b4e2b5e4fe tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:33.221534 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a42f299b-1530-41e6-a7e2-32b4e2b5e4fe tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1599 microversion: 2.20 time: 0.148597 May 10 14:04:33.222099 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 335/646] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:04:33 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:04:33.238547 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-42edbdfb-207b-4b29-aef8-64b0138bbd55 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:33.239039 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-42edbdfb-207b-4b29-aef8-64b0138bbd55 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:33.245725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-42edbdfb-207b-4b29-aef8-64b0138bbd55 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:33.246170 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-42edbdfb-207b-4b29-aef8-64b0138bbd55 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:33.246932 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-42edbdfb-207b-4b29-aef8-64b0138bbd55 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:33.247632 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-42edbdfb-207b-4b29-aef8-64b0138bbd55 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:33.322149 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-42edbdfb-207b-4b29-aef8-64b0138bbd55 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087386 May 10 14:04:33.322753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 312/647] 10.222.0.49 () {60 vars in 1315 bytes} [Tue May 10 14:04:33 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:04:34.502437 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-74298514-66d3-4268-9d48-56b214b75be0 req-2dae2581-07aa-4a69-b253-8dd4bfe5cf68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e6e847-c76f-441e-a7f8-63251b198a2d", "tag": "7c7e5879-9276-48c6-9f02-0be4571c330e"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:34.510886 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-74298514-66d3-4268-9d48-56b214b75be0 req-2dae2581-07aa-4a69-b253-8dd4bfe5cf68 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:34.511430 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-74298514-66d3-4268-9d48-56b214b75be0 req-2dae2581-07aa-4a69-b253-8dd4bfe5cf68 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:34.522232 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-74298514-66d3-4268-9d48-56b214b75be0 req-2dae2581-07aa-4a69-b253-8dd4bfe5cf68 service nova] Creating event network-changed:7c7e5879-9276-48c6-9f02-0be4571c330e for instance 18e6e847-c76f-441e-a7f8-63251b198a2d on hv-cinder-84067 May 10 14:04:34.527056 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-74298514-66d3-4268-9d48-56b214b75be0 req-2dae2581-07aa-4a69-b253-8dd4bfe5cf68 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028348 May 10 14:04:34.527647 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 336/648] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:39.032519 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-05f844c3-d65b-41e7-90e2-5ec20f8734a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1655833722"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:39.033232 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-05f844c3-d65b-41e7-90e2-5ec20f8734a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:39.041112 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-05f844c3-d65b-41e7-90e2-5ec20f8734a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:39.041558 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-05f844c3-d65b-41e7-90e2-5ec20f8734a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:39.042332 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-05f844c3-d65b-41e7-90e2-5ec20f8734a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:39.042770 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-05f844c3-d65b-41e7-90e2-5ec20f8734a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:39.174474 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.network.security_group_api [None req-05f844c3-d65b-41e7-90e2-5ec20f8734a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Removing security group b68aabd1-8ee1-4921-b3d2-67aaf1765d25 from port 12100075-8151-4b48-9d14-6864846987d2 May 10 14:04:39.515681 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-05f844c3-d65b-41e7-90e2-5ec20f8734a5 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "POST /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/action" status: 202 len: 0 microversion: 2.1 time: 0.488487 May 10 14:04:39.518892 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 313/649] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:04:39 2022] POST /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:04:39.522821 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-890fe8b7-e43d-49c8-bbac-c9aef43f2841 req-63bc43c4-41e4-44fa-a065-9dfd3d3f43ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8821a821-144b-4a72-b16e-07014a8063d0", "tag": "12100075-8151-4b48-9d14-6864846987d2"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:39.534074 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-890fe8b7-e43d-49c8-bbac-c9aef43f2841 req-63bc43c4-41e4-44fa-a065-9dfd3d3f43ef service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:39.534812 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-890fe8b7-e43d-49c8-bbac-c9aef43f2841 req-63bc43c4-41e4-44fa-a065-9dfd3d3f43ef service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:39.549712 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-890fe8b7-e43d-49c8-bbac-c9aef43f2841 req-63bc43c4-41e4-44fa-a065-9dfd3d3f43ef service nova] Creating event network-changed:12100075-8151-4b48-9d14-6864846987d2 for instance 8821a821-144b-4a72-b16e-07014a8063d0 on hv-cinder-84067 May 10 14:04:39.554993 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-890fe8b7-e43d-49c8-bbac-c9aef43f2841 req-63bc43c4-41e4-44fa-a065-9dfd3d3f43ef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037092 May 10 14:04:39.556307 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 337/650] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:40.611400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-50bf2444-812b-4e84-964c-88cf27c76a82 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:40.612054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-50bf2444-812b-4e84-964c-88cf27c76a82 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:40.614508 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-3c3a1326-23ce-4293-a352-25a48401c1cb req-857f1487-9a4b-4094-a2b6-2f6b98d2094b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8821a821-144b-4a72-b16e-07014a8063d0", "tag": "12100075-8151-4b48-9d14-6864846987d2"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:40.619318 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-50bf2444-812b-4e84-964c-88cf27c76a82 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:40.619768 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-50bf2444-812b-4e84-964c-88cf27c76a82 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:40.621065 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-50bf2444-812b-4e84-964c-88cf27c76a82 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:40.621512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-50bf2444-812b-4e84-964c-88cf27c76a82 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:40.622383 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-3c3a1326-23ce-4293-a352-25a48401c1cb req-857f1487-9a4b-4094-a2b6-2f6b98d2094b service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:40.622822 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-3c3a1326-23ce-4293-a352-25a48401c1cb req-857f1487-9a4b-4094-a2b6-2f6b98d2094b service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:40.634083 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-3c3a1326-23ce-4293-a352-25a48401c1cb req-857f1487-9a4b-4094-a2b6-2f6b98d2094b service nova] Creating event network-changed:12100075-8151-4b48-9d14-6864846987d2 for instance 8821a821-144b-4a72-b16e-07014a8063d0 on hv-cinder-84067 May 10 14:04:40.639076 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-3c3a1326-23ce-4293-a352-25a48401c1cb req-857f1487-9a4b-4094-a2b6-2f6b98d2094b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029241 May 10 14:04:40.639992 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 338/651] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:40.702821 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-50bf2444-812b-4e84-964c-88cf27c76a82 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lazy-loading 'services' on Instance uuid 8821a821-144b-4a72-b16e-07014a8063d0 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:04:40.782384 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-50bf2444-812b-4e84-964c-88cf27c76a82 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/os-volume_attachments/bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf" status: 202 len: 0 microversion: 2.1 time: 0.173901 May 10 14:04:40.786487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 314/652] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 14:04:40 2022] DELETE /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/os-volume_attachments/bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:04:40.792602 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ca8c549b-25d8-42a9-af80-159aef5914e6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:40.793644 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ca8c549b-25d8-42a9-af80-159aef5914e6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:40.800263 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ca8c549b-25d8-42a9-af80-159aef5914e6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:40.800724 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ca8c549b-25d8-42a9-af80-159aef5914e6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:40.801499 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ca8c549b-25d8-42a9-af80-159aef5914e6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:40.802216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ca8c549b-25d8-42a9-af80-159aef5914e6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:40.852522 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ca8c549b-25d8-42a9-af80-159aef5914e6 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064273 May 10 14:04:40.853109 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 339/653] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:04:40 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:04:41.864876 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-74ad1ec2-ed98-4fd2-9689-3bb5956ea02a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:41.866114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-74ad1ec2-ed98-4fd2-9689-3bb5956ea02a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:41.872967 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-74ad1ec2-ed98-4fd2-9689-3bb5956ea02a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:41.873353 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-74ad1ec2-ed98-4fd2-9689-3bb5956ea02a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:41.874126 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-74ad1ec2-ed98-4fd2-9689-3bb5956ea02a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:41.874560 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-74ad1ec2-ed98-4fd2-9689-3bb5956ea02a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:41.904265 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-74ad1ec2-ed98-4fd2-9689-3bb5956ea02a tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043675 May 10 14:04:41.904837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 315/654] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:04:41 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 14:04:41.917021 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-48816789-1e8f-4a3b-b098-85333e2023ae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:41.917560 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-48816789-1e8f-4a3b-b098-85333e2023ae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:41.923757 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-48816789-1e8f-4a3b-b098-85333e2023ae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:41.924242 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-48816789-1e8f-4a3b-b098-85333e2023ae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:41.925012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-48816789-1e8f-4a3b-b098-85333e2023ae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:41.925454 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-48816789-1e8f-4a3b-b098-85333e2023ae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:42.002908 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-48816789-1e8f-4a3b-b098-85333e2023ae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] HTTP exception thrown: Instance 8821a821-144b-4a72-b16e-07014a8063d0 is not attached to volume bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-48816789-1e8f-4a3b-b098-85333e2023ae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Request method failure captured: May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: DELETE /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/os-volume_attachments/bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf HTTP/1.1 May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABienBLibtH7O_LSczAt8NJrrJwGHxR0R-vfXBfwxWZ1ABZrkPj37RF4oEDE3t7maDozeLlZ_iEU8FLD3pQ2QOLBAQoh12n7ho6Ak7jy3p2EnYb-EMisADa1cKT2rYOHeCeb2oNOsjdjb3q5kkYBmAnMucjH6uc8gr5Q7ZYwOcEjaiENz0 May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: b1e759f08bf04eeabbbc1b14bca8a169 May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-TestMinimumBasicScenario-947862200 May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:04:42.009031 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:04:42.011700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1e759f08bf04eeabbbc1b14bca8a169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b1e759f08bf04eeabbbc1b14bca8a169"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b1e759f08bf04eeabbbc1b14bca8a169"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1e759f08bf04eeabbbc1b14bca8a169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:04:42.011700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-TestMinimumBasicScenario-947862200 May 10 14:04:42.011700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: b1e759f08bf04eeabbbc1b14bca8a169 May 10 14:04:42.011700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-TestMinimumBasicScenario-947862200 May 10 14:04:42.011700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-TestMinimumBasicScenario-947862200-project May 10 14:04:42.011700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:04:42.011700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:04:42.011700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: c4f57917c86244c2baecd9d795c502c4 May 10 14:04:42.011700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-TestMinimumBasicScenario-947862200-project May 10 14:04:42.011700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:04:42.011700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 8821a821-144b-4a72-b16e-07014a8063d0 is not attached to volume bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'server_id': '8821a821-144b-4a72-b16e-07014a8063d0', 'id': 'bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf'} May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf. May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:04:42.013695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8821a821-144b-4a72-b16e-07014a8063d0 is not attached to volume bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8821a821-144b-4a72-b16e-07014a8063d0 is not attached to volume bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:04:42.016461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-48816789-1e8f-4a3b-b098-85333e2023ae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Returning 404 to user: Instance 8821a821-144b-4a72-b16e-07014a8063d0 is not attached to volume bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:04:42.018685 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-48816789-1e8f-4a3b-b098-85333e2023ae tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/os-volume_attachments/bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf" status: 404 len: 154 microversion: 2.1 time: 0.099748 May 10 14:04:42.018685 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 340/655] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 14:04:41 2022] DELETE /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0/os-volume_attachments/bf40d9b3-5dc6-4b6b-9bf4-d319a6300ddf => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:04:43.146491 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-41bd12ef-a41f-4872-bcec-446b69d6b76e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:43.146983 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-41bd12ef-a41f-4872-bcec-446b69d6b76e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:43.153203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-41bd12ef-a41f-4872-bcec-446b69d6b76e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:43.153646 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-41bd12ef-a41f-4872-bcec-446b69d6b76e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:43.154402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-41bd12ef-a41f-4872-bcec-446b69d6b76e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:43.154831 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-41bd12ef-a41f-4872-bcec-446b69d6b76e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:43.178292 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-41bd12ef-a41f-4872-bcec-446b69d6b76e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Going to try to terminate instance {{(pid=117153) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:04:43.249790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-41bd12ef-a41f-4872-bcec-446b69d6b76e tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 204 len: 0 microversion: 2.1 time: 0.107059 May 10 14:04:43.250376 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 316/656] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:04:43 2022] DELETE /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:04:43.260649 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3b734e18-63aa-4cef-8f84-26a2c74e7767 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:43.261257 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3b734e18-63aa-4cef-8f84-26a2c74e7767 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:43.267256 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3b734e18-63aa-4cef-8f84-26a2c74e7767 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:43.267710 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3b734e18-63aa-4cef-8f84-26a2c74e7767 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:43.268516 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3b734e18-63aa-4cef-8f84-26a2c74e7767 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:43.268956 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3b734e18-63aa-4cef-8f84-26a2c74e7767 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:43.398939 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3b734e18-63aa-4cef-8f84-26a2c74e7767 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:43.408935 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3b734e18-63aa-4cef-8f84-26a2c74e7767 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1554 microversion: 2.1 time: 0.154001 May 10 14:04:43.409626 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 341/657] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:43 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:44.046871 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5910dcdc-1265-4706-8a96-42274d0b59a3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:44.047867 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-5910dcdc-1265-4706-8a96-42274d0b59a3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:44.053693 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5910dcdc-1265-4706-8a96-42274d0b59a3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:44.054138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5910dcdc-1265-4706-8a96-42274d0b59a3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:44.054891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5910dcdc-1265-4706-8a96-42274d0b59a3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:44.055321 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5910dcdc-1265-4706-8a96-42274d0b59a3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:44.082563 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-5910dcdc-1265-4706-8a96-42274d0b59a3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039913 May 10 14:04:44.083091 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 317/658] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:04:44 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:04:44.139246 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1766118c-372e-43f7-b3eb-514b7bf2a472 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:44.139738 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1766118c-372e-43f7-b3eb-514b7bf2a472 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:44.145743 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1766118c-372e-43f7-b3eb-514b7bf2a472 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:44.146789 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1766118c-372e-43f7-b3eb-514b7bf2a472 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:44.147546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1766118c-372e-43f7-b3eb-514b7bf2a472 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:44.147977 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1766118c-372e-43f7-b3eb-514b7bf2a472 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:44.171334 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1766118c-372e-43f7-b3eb-514b7bf2a472 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Going to try to terminate instance {{(pid=117154) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:04:44.242365 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1766118c-372e-43f7-b3eb-514b7bf2a472 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 204 len: 0 microversion: 2.1 time: 0.106584 May 10 14:04:44.242954 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 342/659] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:04:44 2022] DELETE /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:04:44.251066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2e156e9a-f587-4f9b-a12f-61297d6d4374 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:44.251616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2e156e9a-f587-4f9b-a12f-61297d6d4374 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:44.258499 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2e156e9a-f587-4f9b-a12f-61297d6d4374 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:44.258948 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2e156e9a-f587-4f9b-a12f-61297d6d4374 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:44.259711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2e156e9a-f587-4f9b-a12f-61297d6d4374 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:44.260148 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2e156e9a-f587-4f9b-a12f-61297d6d4374 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:44.385908 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2e156e9a-f587-4f9b-a12f-61297d6d4374 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:44.393227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2e156e9a-f587-4f9b-a12f-61297d6d4374 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1673 microversion: 2.1 time: 0.146050 May 10 14:04:44.393857 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 318/660] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:44 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:44.426983 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-06ec349c-e26c-45c4-af52-8ddd26ca3e8d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:44.427760 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-06ec349c-e26c-45c4-af52-8ddd26ca3e8d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:44.434050 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-06ec349c-e26c-45c4-af52-8ddd26ca3e8d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:44.434500 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-06ec349c-e26c-45c4-af52-8ddd26ca3e8d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:44.435260 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-06ec349c-e26c-45c4-af52-8ddd26ca3e8d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:44.435697 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-06ec349c-e26c-45c4-af52-8ddd26ca3e8d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:44.567018 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-06ec349c-e26c-45c4-af52-8ddd26ca3e8d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:44.574298 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-06ec349c-e26c-45c4-af52-8ddd26ca3e8d tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1554 microversion: 2.1 time: 0.151548 May 10 14:04:44.574880 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 343/661] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:44 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:45.409829 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bbfc409c-2f75-44b4-8b9a-94ff5cd2b639 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:45.410453 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bbfc409c-2f75-44b4-8b9a-94ff5cd2b639 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:45.417561 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbfc409c-2f75-44b4-8b9a-94ff5cd2b639 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:45.418010 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbfc409c-2f75-44b4-8b9a-94ff5cd2b639 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:45.418779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbfc409c-2f75-44b4-8b9a-94ff5cd2b639 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:45.419237 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbfc409c-2f75-44b4-8b9a-94ff5cd2b639 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:45.547743 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bbfc409c-2f75-44b4-8b9a-94ff5cd2b639 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:45.554992 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bbfc409c-2f75-44b4-8b9a-94ff5cd2b639 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1673 microversion: 2.1 time: 0.149021 May 10 14:04:45.555568 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 319/662] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:45 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:45.591462 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e4c3f7d5-f396-49b7-bf92-8dd708df0c12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:45.592075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e4c3f7d5-f396-49b7-bf92-8dd708df0c12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:45.598776 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4c3f7d5-f396-49b7-bf92-8dd708df0c12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:45.599252 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4c3f7d5-f396-49b7-bf92-8dd708df0c12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:45.600041 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4c3f7d5-f396-49b7-bf92-8dd708df0c12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:45.600507 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4c3f7d5-f396-49b7-bf92-8dd708df0c12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:45.725620 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e4c3f7d5-f396-49b7-bf92-8dd708df0c12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:45.732851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e4c3f7d5-f396-49b7-bf92-8dd708df0c12 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1554 microversion: 2.1 time: 0.145173 May 10 14:04:45.733432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 344/663] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:45 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1554 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:46.572269 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-49c81945-d9f9-4c78-b8cf-3901d9288442 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:46.572880 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-49c81945-d9f9-4c78-b8cf-3901d9288442 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:46.579168 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-49c81945-d9f9-4c78-b8cf-3901d9288442 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:46.579623 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-49c81945-d9f9-4c78-b8cf-3901d9288442 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:46.580424 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-49c81945-d9f9-4c78-b8cf-3901d9288442 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:46.580866 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-49c81945-d9f9-4c78-b8cf-3901d9288442 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:46.706174 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-49c81945-d9f9-4c78-b8cf-3901d9288442 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:46.713943 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-49c81945-d9f9-4c78-b8cf-3901d9288442 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1673 microversion: 2.1 time: 0.145678 May 10 14:04:46.714517 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 320/664] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:46 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:46.750312 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-42a6a189-6751-45b8-b046-0df2770e3072 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:46.750928 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-42a6a189-6751-45b8-b046-0df2770e3072 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:46.757256 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-42a6a189-6751-45b8-b046-0df2770e3072 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:46.757702 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-42a6a189-6751-45b8-b046-0df2770e3072 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:46.758464 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-42a6a189-6751-45b8-b046-0df2770e3072 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:46.758900 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-42a6a189-6751-45b8-b046-0df2770e3072 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:46.883179 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-42a6a189-6751-45b8-b046-0df2770e3072 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:46.890345 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-42a6a189-6751-45b8-b046-0df2770e3072 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1554 microversion: 2.1 time: 0.143943 May 10 14:04:46.890937 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 345/665] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:46 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1554 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:47.731418 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f70bff06-d338-4631-8030-4f934af19e42 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:47.732052 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f70bff06-d338-4631-8030-4f934af19e42 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:47.738440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f70bff06-d338-4631-8030-4f934af19e42 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:47.738896 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f70bff06-d338-4631-8030-4f934af19e42 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:47.740362 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f70bff06-d338-4631-8030-4f934af19e42 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:47.740845 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f70bff06-d338-4631-8030-4f934af19e42 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:47.908387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1ab6d7bd-4838-4c87-a77d-82cd33a1d9aa tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:47.908963 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1ab6d7bd-4838-4c87-a77d-82cd33a1d9aa tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:47.915778 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1ab6d7bd-4838-4c87-a77d-82cd33a1d9aa tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:47.916260 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1ab6d7bd-4838-4c87-a77d-82cd33a1d9aa tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:47.917032 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1ab6d7bd-4838-4c87-a77d-82cd33a1d9aa tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:47.917468 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1ab6d7bd-4838-4c87-a77d-82cd33a1d9aa tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:48.049069 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1ab6d7bd-4838-4c87-a77d-82cd33a1d9aa tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:48.056901 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1ab6d7bd-4838-4c87-a77d-82cd33a1d9aa tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1554 microversion: 2.1 time: 0.152686 May 10 14:04:48.057493 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 346/666] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:47 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:48.078167 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f70bff06-d338-4631-8030-4f934af19e42 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:48.085453 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f70bff06-d338-4631-8030-4f934af19e42 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1673 microversion: 2.1 time: 0.358080 May 10 14:04:48.086242 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 321/667] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:47 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1673 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:48.536142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-c86e31bf-253f-4b6d-8ef4-ef8a8a8c7cea req-84a6a177-b792-4e4d-a7ff-d8604a469e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8821a821-144b-4a72-b16e-07014a8063d0", "name": "network-vif-deleted", "tag": "12100075-8151-4b48-9d14-6864846987d2"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:48.545913 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-c86e31bf-253f-4b6d-8ef4-ef8a8a8c7cea req-84a6a177-b792-4e4d-a7ff-d8604a469e19 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:48.546417 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-c86e31bf-253f-4b6d-8ef4-ef8a8a8c7cea req-84a6a177-b792-4e4d-a7ff-d8604a469e19 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:48.558059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-c86e31bf-253f-4b6d-8ef4-ef8a8a8c7cea req-84a6a177-b792-4e4d-a7ff-d8604a469e19 service nova] Creating event network-vif-deleted:12100075-8151-4b48-9d14-6864846987d2 for instance 8821a821-144b-4a72-b16e-07014a8063d0 on hv-cinder-84067 May 10 14:04:48.562958 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-c86e31bf-253f-4b6d-8ef4-ef8a8a8c7cea req-84a6a177-b792-4e4d-a7ff-d8604a469e19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030414 May 10 14:04:48.563731 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 347/668] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:49.075874 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ace9ef31-586d-40fa-a0cc-f2dd5a11b047 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:49.076686 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ace9ef31-586d-40fa-a0cc-f2dd5a11b047 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:49.087903 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ace9ef31-586d-40fa-a0cc-f2dd5a11b047 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:49.088813 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ace9ef31-586d-40fa-a0cc-f2dd5a11b047 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:49.089845 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ace9ef31-586d-40fa-a0cc-f2dd5a11b047 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:49.090495 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ace9ef31-586d-40fa-a0cc-f2dd5a11b047 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:49.111541 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0adbb23f-c51d-42bf-93f9-4f4c67b620fe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:49.112378 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0adbb23f-c51d-42bf-93f9-4f4c67b620fe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:49.133850 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0adbb23f-c51d-42bf-93f9-4f4c67b620fe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:49.134317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0adbb23f-c51d-42bf-93f9-4f4c67b620fe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:49.135111 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0adbb23f-c51d-42bf-93f9-4f4c67b620fe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:49.135557 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0adbb23f-c51d-42bf-93f9-4f4c67b620fe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:49.157212 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ace9ef31-586d-40fa-a0cc-f2dd5a11b047 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:49.157589 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ace9ef31-586d-40fa-a0cc-f2dd5a11b047 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:49.158053 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-ace9ef31-586d-40fa-a0cc-f2dd5a11b047 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lazy-loading 'fault' on Instance uuid 8821a821-144b-4a72-b16e-07014a8063d0 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:04:49.199795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0adbb23f-c51d-42bf-93f9-4f4c67b620fe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:49.200745 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0adbb23f-c51d-42bf-93f9-4f4c67b620fe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:49.201593 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-0adbb23f-c51d-42bf-93f9-4f4c67b620fe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lazy-loading 'fault' on Instance uuid c22e54ed-bbfa-42df-af34-67721740c4b0 {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:04:49.204696 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ace9ef31-586d-40fa-a0cc-f2dd5a11b047 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f57917c86244c2baecd9d795c502c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e759f08bf04eeabbbc1b14bca8a169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:49.228508 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ace9ef31-586d-40fa-a0cc-f2dd5a11b047 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 200 len: 1348 microversion: 2.1 time: 0.158390 May 10 14:04:49.244551 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 322/669] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:49 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 1348 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:49.259112 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0adbb23f-c51d-42bf-93f9-4f4c67b620fe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:49.267055 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0adbb23f-c51d-42bf-93f9-4f4c67b620fe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 200 len: 1328 microversion: 2.1 time: 0.166905 May 10 14:04:49.267974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 348/670] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:49 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 1328 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:50.245401 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-23127fe2-68e5-4c97-a316-14f392a0a954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:50.245939 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-23127fe2-68e5-4c97-a316-14f392a0a954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] [instance: 8821a821-144b-4a72-b16e-07014a8063d0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:50.252890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-23127fe2-68e5-4c97-a316-14f392a0a954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:50.253344 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-23127fe2-68e5-4c97-a316-14f392a0a954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:50.254114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-23127fe2-68e5-4c97-a316-14f392a0a954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:50.254557 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-23127fe2-68e5-4c97-a316-14f392a0a954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:50.268068 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-23127fe2-68e5-4c97-a316-14f392a0a954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] HTTP exception thrown: Instance 8821a821-144b-4a72-b16e-07014a8063d0 could not be found. May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-23127fe2-68e5-4c97-a316-14f392a0a954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Request method failure captured: May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 HTTP/1.1 May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABienBLibtH7O_LSczAt8NJrrJwGHxR0R-vfXBfwxWZ1ABZrkPj37RF4oEDE3t7maDozeLlZ_iEU8FLD3pQ2QOLBAQoh12n7ho6Ak7jy3p2EnYb-EMisADa1cKT2rYOHeCeb2oNOsjdjb3q5kkYBmAnMucjH6uc8gr5Q7ZYwOcEjaiENz0 May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: b1e759f08bf04eeabbbc1b14bca8a169 May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-TestMinimumBasicScenario-947862200 May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:04:50.270043 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:04:50.272131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1e759f08bf04eeabbbc1b14bca8a169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b1e759f08bf04eeabbbc1b14bca8a169"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b1e759f08bf04eeabbbc1b14bca8a169"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1e759f08bf04eeabbbc1b14bca8a169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:04:50.272131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-TestMinimumBasicScenario-947862200 May 10 14:04:50.272131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: b1e759f08bf04eeabbbc1b14bca8a169 May 10 14:04:50.272131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-TestMinimumBasicScenario-947862200 May 10 14:04:50.272131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-TestMinimumBasicScenario-947862200-project May 10 14:04:50.272131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:04:50.272131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:04:50.272131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: c4f57917c86244c2baecd9d795c502c4 May 10 14:04:50.272131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-TestMinimumBasicScenario-947862200-project May 10 14:04:50.272131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:04:50.272131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 8821a821-144b-4a72-b16e-07014a8063d0 could not be found. May 10 14:04:50.272131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '8821a821-144b-4a72-b16e-07014a8063d0'} May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8821a821-144b-4a72-b16e-07014a8063d0 could not be found. May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:04:50.272942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8821a821-144b-4a72-b16e-07014a8063d0 could not be found. May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8821a821-144b-4a72-b16e-07014a8063d0 could not be found. May 10 14:04:50.274616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:50.276244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-23127fe2-68e5-4c97-a316-14f392a0a954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Returning 404 to user: Instance 8821a821-144b-4a72-b16e-07014a8063d0 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:04:50.276244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-23127fe2-68e5-4c97-a316-14f392a0a954 tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0" status: 404 len: 111 microversion: 2.1 time: 0.030515 May 10 14:04:50.276244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 323/671] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:50 2022] GET /compute/v2.1/servers/8821a821-144b-4a72-b16e-07014a8063d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:04:50.280609 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8024a514-156e-4884-9ab3-c274f99d703f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] Calling method '.version_select at 0x7f5f803368b0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:50.283948 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-04aff251-f9d8-470b-9c26-d881cd5ae0b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:50.284593 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-04aff251-f9d8-470b-9c26-d881cd5ae0b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:50.290828 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-04aff251-f9d8-470b-9c26-d881cd5ae0b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:50.291277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-04aff251-f9d8-470b-9c26-d881cd5ae0b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:50.292049 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-04aff251-f9d8-470b-9c26-d881cd5ae0b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:50.292522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-04aff251-f9d8-470b-9c26-d881cd5ae0b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:50.299629 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8024a514-156e-4884-9ab3-c274f99d703f tempest-TestMinimumBasicScenario-947862200 tempest-TestMinimumBasicScenario-947862200-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1111046983" status: 202 len: 0 microversion: 2.1 time: 0.022629 May 10 14:04:50.304207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 349/672] 10.222.0.49 () {58 vars in 1271 bytes} [Tue May 10 14:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1111046983 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:04:50.306846 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-04aff251-f9d8-470b-9c26-d881cd5ae0b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] HTTP exception thrown: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-04aff251-f9d8-470b-9c26-d881cd5ae0b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Request method failure captured: May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 HTTP/1.1 May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_mmufc0OWqFF7O8mzSBXxYHB8G0788yc_O8qZYvyXLGjheC8B270Zpl2fVrw-x1mj5axEs8z0VrCuNg-N9k4yYnKpJlNpsfdUuaoLQObtF3ICzUwRSdOh4xzcRuUhgd_lWt98GcivmpLjJFQl3oaXxD3ufZuoROtwFQwx231em1QM May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: d19ea52173a04c8e8624b91ac0e3eb48 May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-AttachVolumeTestJSON-1851863849 May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:04:50.308391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:04:50.309691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:04:50.309691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-AttachVolumeTestJSON-1851863849 May 10 14:04:50.309691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: d19ea52173a04c8e8624b91ac0e3eb48 May 10 14:04:50.309691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1851863849 May 10 14:04:50.309691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-AttachVolumeTestJSON-1851863849-project May 10 14:04:50.309691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:04:50.309691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:04:50.309691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: def10f42c8744e1d8526087c874ceedd May 10 14:04:50.309691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-AttachVolumeTestJSON-1851863849-project May 10 14:04:50.309691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:04:50.309691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:04:50.309691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': 'c22e54ed-bbfa-42df-af34-67721740c4b0'} May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:04:50.310459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:04:50.311591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:04:50.312688 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-04aff251-f9d8-470b-9c26-d881cd5ae0b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Returning 404 to user: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:04:50.312688 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-04aff251-f9d8-470b-9c26-d881cd5ae0b3 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 404 len: 111 microversion: 2.1 time: 0.029376 May 10 14:04:50.312688 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 324/673] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:50 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:04:50.318829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bc845881-fa94-432d-b417-813f99a49d1a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '.version_select at 0x7f5f7c07d040>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:50.335968 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-bc845881-fa94-432d-b417-813f99a49d1a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133810948" status: 202 len: 0 microversion: 2.1 time: 0.021250 May 10 14:04:50.336653 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 350/674] 10.222.0.49 () {58 vars in 1220 bytes} [Tue May 10 14:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133810948 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:04:50.591301 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-2abb75a1-ec26-4c05-8b24-90511f3354e2 req-897607f6-728a-4bbc-9cba-31646c810280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22e54ed-bbfa-42df-af34-67721740c4b0", "name": "network-vif-deleted", "tag": "48a907c3-b5e2-4fd8-b6cb-cc60b528bc16"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:50.599924 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-2abb75a1-ec26-4c05-8b24-90511f3354e2 req-897607f6-728a-4bbc-9cba-31646c810280 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:50.600406 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-2abb75a1-ec26-4c05-8b24-90511f3354e2 req-897607f6-728a-4bbc-9cba-31646c810280 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:50.611712 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-2abb75a1-ec26-4c05-8b24-90511f3354e2 req-897607f6-728a-4bbc-9cba-31646c810280 service nova] Creating event network-vif-deleted:48a907c3-b5e2-4fd8-b6cb-cc60b528bc16 for instance c22e54ed-bbfa-42df-af34-67721740c4b0 on hv-cinder-84067 May 10 14:04:50.618007 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-2abb75a1-ec26-4c05-8b24-90511f3354e2 req-897607f6-728a-4bbc-9cba-31646c810280 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030318 May 10 14:04:50.618606 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 325/675] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:50.983516 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d9000c50-444f-4e80-a322-d5ea81d0e12b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Action: 'create', calling method: .version_select at 0x7f5f802e5c10>, body: {"keypair": {"name": "tempest-keypair-228695749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHG3e2DfljBlcqpwSIXfNPENpomvX7VQMGa2FxW/5M7qLqvdhc5Y2XE7xn4LQEpEUu1FKpIUjsWnztD4NhufWcTXGdhjdOerqEeoFDMdyTlclqolBTFLq3UHfAP+FxqMFg=="}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:50.997686 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-d9000c50-444f-4e80-a322-d5ea81d0e12b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Getting quotas for project d19ea52173a04c8e8624b91ac0e3eb48. Resources: {'key_pairs'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:04:51.001330 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-d9000c50-444f-4e80-a322-d5ea81d0e12b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Getting quotas for user def10f42c8744e1d8526087c874ceedd and project d19ea52173a04c8e8624b91ac0e3eb48. Resources: {'key_pairs'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:04:51.026749 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d9000c50-444f-4e80-a322-d5ea81d0e12b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047105 May 10 14:04:51.027360 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 351/676] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 14:04:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:04:52.338075 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-665003923", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad65d3a2-8251-4281-96ce-37b7d361be92"}], "security_groups": [{"name": "tempest-securitygroup--753369284"}], "key_name": "tempest-keypair-228695749", "user_data": "}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:52.515165 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.network.neutron [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] validate_networks() for [('ad65d3a2-8251-4281-96ce-37b7d361be92', None, None, None, None, None)] {{(pid=117153) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:04:52.984010 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Flavor limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:04:52.984539 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Image limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:04:52.985110 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Flavor pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:04:52.985678 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Image pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:04:52.986159 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:04:52.997153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:52.997782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:52.998852 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:52.999510 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:53.017901 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Getting quotas for project d19ea52173a04c8e8624b91ac0e3eb48. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:04:53.023568 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Getting quotas for user def10f42c8744e1d8526087c874ceedd and project d19ea52173a04c8e8624b91ac0e3eb48. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:04:53.034898 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Going to run 1 instances... {{(pid=117153) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:04:53.038134 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:04:53.089407 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-efc3fe5c-c95b-4372-a267-ae808237743f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.756517 May 10 14:04:53.090622 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 326/677] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:04:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:04:53.101733 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e3b59708-23fc-4348-9d4e-272cc9e90a21 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:53.102492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e3b59708-23fc-4348-9d4e-272cc9e90a21 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:53.372990 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e3b59708-23fc-4348-9d4e-272cc9e90a21 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:53.381220 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e3b59708-23fc-4348-9d4e-272cc9e90a21 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1236 microversion: 2.1 time: 0.283787 May 10 14:04:53.391995 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 352/678] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:53 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1236 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:54.212502 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-38c9e8ee-2d5d-4316-92bb-bc4b24fa82e3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:54.213061 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-38c9e8ee-2d5d-4316-92bb-bc4b24fa82e3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:54.231823 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-38c9e8ee-2d5d-4316-92bb-bc4b24fa82e3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:54.235329 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-38c9e8ee-2d5d-4316-92bb-bc4b24fa82e3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:54.236144 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-38c9e8ee-2d5d-4316-92bb-bc4b24fa82e3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:54.240454 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-38c9e8ee-2d5d-4316-92bb-bc4b24fa82e3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:54.289640 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-38c9e8ee-2d5d-4316-92bb-bc4b24fa82e3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/ips" status: 200 len: 150 microversion: 2.1 time: 0.082308 May 10 14:04:54.290781 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 327/679] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 14:04:54 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/ips => generated 150 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:54.406812 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-dd1cf1b9-a7ce-4bee-96ac-de62d99e911e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:54.409569 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-dd1cf1b9-a7ce-4bee-96ac-de62d99e911e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:54.428272 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-dd1cf1b9-a7ce-4bee-96ac-de62d99e911e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:54.433412 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-dd1cf1b9-a7ce-4bee-96ac-de62d99e911e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:54.434773 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-dd1cf1b9-a7ce-4bee-96ac-de62d99e911e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:54.435813 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-dd1cf1b9-a7ce-4bee-96ac-de62d99e911e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:54.607704 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-dd1cf1b9-a7ce-4bee-96ac-de62d99e911e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:54.621435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-dd1cf1b9-a7ce-4bee-96ac-de62d99e911e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1294 microversion: 2.1 time: 0.227109 May 10 14:04:54.637851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 353/680] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:54 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1294 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:55.645602 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4ab774d2-045f-4857-9939-8ff0a33fa81b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:55.646769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4ab774d2-045f-4857-9939-8ff0a33fa81b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:55.653225 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4ab774d2-045f-4857-9939-8ff0a33fa81b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:55.653994 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4ab774d2-045f-4857-9939-8ff0a33fa81b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:55.655319 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4ab774d2-045f-4857-9939-8ff0a33fa81b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:55.655944 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4ab774d2-045f-4857-9939-8ff0a33fa81b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:55.780829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-80e917c4-7fca-4712-96fc-d55e4b80373c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5abde04-521f-4902-968f-fc0b4388f03c"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:55.783128 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-80e917c4-7fca-4712-96fc-d55e4b80373c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:55.791336 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-80e917c4-7fca-4712-96fc-d55e4b80373c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:55.792024 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-80e917c4-7fca-4712-96fc-d55e4b80373c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:55.793026 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-80e917c4-7fca-4712-96fc-d55e4b80373c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:55.793627 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-80e917c4-7fca-4712-96fc-d55e4b80373c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:56.107604 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-80e917c4-7fca-4712-96fc-d55e4b80373c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331074 May 10 14:04:56.108363 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 354/681] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:04:55 2022] POST /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:56.253012 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4ab774d2-045f-4857-9939-8ff0a33fa81b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:56.261708 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4ab774d2-045f-4857-9939-8ff0a33fa81b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1361 microversion: 2.1 time: 0.620280 May 10 14:04:56.262401 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 328/682] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:55 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1361 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:56.887852 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-463faac8-c72e-4b78-a378-b466a720faf1 req-a5942376-f8e3-4611-b354-377c169b2153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e15393-bc14-4433-b2aa-6d8fb202b9ea", "tag": "4bee32e6-d54c-4a5f-8e31-b4e7945065bc"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:56.902253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-463faac8-c72e-4b78-a378-b466a720faf1 req-a5942376-f8e3-4611-b354-377c169b2153 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:56.902845 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-463faac8-c72e-4b78-a378-b466a720faf1 req-a5942376-f8e3-4611-b354-377c169b2153 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:56.921560 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-463faac8-c72e-4b78-a378-b466a720faf1 req-a5942376-f8e3-4611-b354-377c169b2153 service nova] Creating event network-changed:4bee32e6-d54c-4a5f-8e31-b4e7945065bc for instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea on hv-cinder-84067 May 10 14:04:56.927763 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-463faac8-c72e-4b78-a378-b466a720faf1 req-a5942376-f8e3-4611-b354-377c169b2153 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044213 May 10 14:04:56.928785 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 355/683] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:57.290579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-59ad42c6-fb73-42ed-bb4a-e8eac5bae57f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:57.291318 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-59ad42c6-fb73-42ed-bb4a-e8eac5bae57f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:57.303832 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-59ad42c6-fb73-42ed-bb4a-e8eac5bae57f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:57.304579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-59ad42c6-fb73-42ed-bb4a-e8eac5bae57f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:57.306125 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-59ad42c6-fb73-42ed-bb4a-e8eac5bae57f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:57.306756 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-59ad42c6-fb73-42ed-bb4a-e8eac5bae57f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:57.612779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-59ad42c6-fb73-42ed-bb4a-e8eac5bae57f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:57.629334 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-59ad42c6-fb73-42ed-bb4a-e8eac5bae57f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1361 microversion: 2.1 time: 0.351186 May 10 14:04:57.631435 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 329/684] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:57 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:58.650797 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-79dd9690-fded-4a4b-a83e-efc8d3b6fb02 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:58.651506 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-79dd9690-fded-4a4b-a83e-efc8d3b6fb02 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:58.658338 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-79dd9690-fded-4a4b-a83e-efc8d3b6fb02 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:58.658799 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-79dd9690-fded-4a4b-a83e-efc8d3b6fb02 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:58.659582 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-79dd9690-fded-4a4b-a83e-efc8d3b6fb02 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:58.660021 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-79dd9690-fded-4a4b-a83e-efc8d3b6fb02 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:58.796985 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-79dd9690-fded-4a4b-a83e-efc8d3b6fb02 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:58.804532 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-79dd9690-fded-4a4b-a83e-efc8d3b6fb02 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1361 microversion: 2.1 time: 0.157861 May 10 14:04:58.805118 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 356/685] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:58 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:59.826583 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-83f7807f-5dd2-4b0a-944b-0921510bc0f7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:59.827320 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-83f7807f-5dd2-4b0a-944b-0921510bc0f7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:59.833446 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-83f7807f-5dd2-4b0a-944b-0921510bc0f7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:59.833899 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-83f7807f-5dd2-4b0a-944b-0921510bc0f7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:59.834680 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-83f7807f-5dd2-4b0a-944b-0921510bc0f7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:59.835126 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-83f7807f-5dd2-4b0a-944b-0921510bc0f7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:59.971651 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-83f7807f-5dd2-4b0a-944b-0921510bc0f7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:59.979405 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-83f7807f-5dd2-4b0a-944b-0921510bc0f7 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1361 microversion: 2.1 time: 0.161381 May 10 14:04:59.979957 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 330/686] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:04:59 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:00.996470 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d74a1baa-55b5-4f4e-8389-94034bebab53 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:00.997033 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d74a1baa-55b5-4f4e-8389-94034bebab53 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:01.003478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d74a1baa-55b5-4f4e-8389-94034bebab53 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:01.003921 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d74a1baa-55b5-4f4e-8389-94034bebab53 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:01.005297 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d74a1baa-55b5-4f4e-8389-94034bebab53 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:01.005754 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d74a1baa-55b5-4f4e-8389-94034bebab53 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:01.133713 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d74a1baa-55b5-4f4e-8389-94034bebab53 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:01.141473 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d74a1baa-55b5-4f4e-8389-94034bebab53 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1361 microversion: 2.1 time: 0.149197 May 10 14:05:01.142165 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 357/687] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:00 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:02.157915 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-68245d22-664d-44c1-bd86-c9665be6e557 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:02.158540 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-68245d22-664d-44c1-bd86-c9665be6e557 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:02.165282 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-68245d22-664d-44c1-bd86-c9665be6e557 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:02.165726 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-68245d22-664d-44c1-bd86-c9665be6e557 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:02.166483 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-68245d22-664d-44c1-bd86-c9665be6e557 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:02.166921 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-68245d22-664d-44c1-bd86-c9665be6e557 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:02.290835 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-68245d22-664d-44c1-bd86-c9665be6e557 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:02.298247 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-68245d22-664d-44c1-bd86-c9665be6e557 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1361 microversion: 2.1 time: 0.144136 May 10 14:05:02.298816 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 331/688] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:02 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:02.654428 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-57ebd841-d9c6-4e2c-a66f-f08bdebb9914 req-fd47ba8b-01d7-4a96-b349-72e2eb5bfeab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e15393-bc14-4433-b2aa-6d8fb202b9ea", "name": "network-vif-plugged", "status": "completed", "tag": "4bee32e6-d54c-4a5f-8e31-b4e7945065bc"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:02.662941 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-57ebd841-d9c6-4e2c-a66f-f08bdebb9914 req-fd47ba8b-01d7-4a96-b349-72e2eb5bfeab service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:02.663592 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-57ebd841-d9c6-4e2c-a66f-f08bdebb9914 req-fd47ba8b-01d7-4a96-b349-72e2eb5bfeab service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:02.674588 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-57ebd841-d9c6-4e2c-a66f-f08bdebb9914 req-fd47ba8b-01d7-4a96-b349-72e2eb5bfeab service nova] Creating event network-vif-plugged:4bee32e6-d54c-4a5f-8e31-b4e7945065bc for instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea on hv-cinder-84067 May 10 14:05:02.679813 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-57ebd841-d9c6-4e2c-a66f-f08bdebb9914 req-fd47ba8b-01d7-4a96-b349-72e2eb5bfeab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029037 May 10 14:05:02.680456 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 358/689] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:05:03.315660 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bd102c19-6fdf-4c92-addc-b4a6eeb14f6e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:03.316310 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bd102c19-6fdf-4c92-addc-b4a6eeb14f6e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:03.323242 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bd102c19-6fdf-4c92-addc-b4a6eeb14f6e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:03.323692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bd102c19-6fdf-4c92-addc-b4a6eeb14f6e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:03.324498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bd102c19-6fdf-4c92-addc-b4a6eeb14f6e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:03.324937 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bd102c19-6fdf-4c92-addc-b4a6eeb14f6e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:03.448917 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bd102c19-6fdf-4c92-addc-b4a6eeb14f6e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:03.456029 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bd102c19-6fdf-4c92-addc-b4a6eeb14f6e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1361 microversion: 2.1 time: 0.144274 May 10 14:05:03.456643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 332/690] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:03 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:03.686851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-15880d63-dd87-4e48-9b44-22436a8305cd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5abde04-521f-4902-968f-fc0b4388f03c"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:03.688009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-15880d63-dd87-4e48-9b44-22436a8305cd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:03.693954 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-15880d63-dd87-4e48-9b44-22436a8305cd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:03.694394 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-15880d63-dd87-4e48-9b44-22436a8305cd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:03.695145 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-15880d63-dd87-4e48-9b44-22436a8305cd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:03.695575 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-15880d63-dd87-4e48-9b44-22436a8305cd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:03.770374 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-15880d63-dd87-4e48-9b44-22436a8305cd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Invalid volume: volume a5abde04-521f-4902-968f-fc0b4388f03c is already attached to instances: 61ade9bf-f1d4-454c-928b-bb882c680d30 May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-15880d63-dd87-4e48-9b44-22436a8305cd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: POST /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments HTTP/1.1 May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 74 May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:05:03.772082 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:05:03.773492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:05:03.773492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:05:03.773492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:05:03.773492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:05:03.773492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:05:03.773492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:05:03.773492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:05:03.773492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:05:03.773492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:05:03.773492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: May 10 14:05:03.773492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {"volumeAttachment": {"volumeId": "a5abde04-521f-4902-968f-fc0b4388f03c"}} May 10 14:05:03.773492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Invalid volume: volume a5abde04-521f-4902-968f-fc0b4388f03c is already attached to instances: 61ade9bf-f1d4-454c-928b-bb882c680d30 May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'server_id': '61ade9bf-f1d4-454c-928b-bb882c680d30', 'body': {'volumeAttachment': {'volumeId': 'a5abde04-521f-4902-968f-fc0b4388f03c'}}} May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a5abde04-521f-4902-968f-fc0b4388f03c is already attached to instances: 61ade9bf-f1d4-454c-928b-bb882c680d30 May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:03.774221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a5abde04-521f-4902-968f-fc0b4388f03c is already attached to instances: 61ade9bf-f1d4-454c-928b-bb882c680d30 May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:03.775406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:03.776588 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:03.776588 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:05:03.776588 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:05:03.776588 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a5abde04-521f-4902-968f-fc0b4388f03c is already attached to instances: 61ade9bf-f1d4-454c-928b-bb882c680d30 May 10 14:05:03.776588 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:03.776588 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-15880d63-dd87-4e48-9b44-22436a8305cd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 400 to user: Invalid volume: volume a5abde04-521f-4902-968f-fc0b4388f03c is already attached to instances: 61ade9bf-f1d4-454c-928b-bb882c680d30 {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:05:03.776588 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-15880d63-dd87-4e48-9b44-22436a8305cd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091589 May 10 14:05:03.776588 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 359/691] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:05:03 2022] POST /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:05:03.833384 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e1d749c7-3b04-42b0-a48f-5893a8cf6a2c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:03.833875 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e1d749c7-3b04-42b0-a48f-5893a8cf6a2c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:03.839783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e1d749c7-3b04-42b0-a48f-5893a8cf6a2c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:03.840272 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e1d749c7-3b04-42b0-a48f-5893a8cf6a2c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:03.841041 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e1d749c7-3b04-42b0-a48f-5893a8cf6a2c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:03.841475 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e1d749c7-3b04-42b0-a48f-5893a8cf6a2c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:03.918508 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-e1d749c7-3b04-42b0-a48f-5893a8cf6a2c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lazy-loading 'services' on Instance uuid 61ade9bf-f1d4-454c-928b-bb882c680d30 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:05:03.988536 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e1d749c7-3b04-42b0-a48f-5893a8cf6a2c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments/a5abde04-521f-4902-968f-fc0b4388f03c" status: 202 len: 0 microversion: 2.1 time: 0.159311 May 10 14:05:03.989157 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 333/692] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 14:05:03 2022] DELETE /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments/a5abde04-521f-4902-968f-fc0b4388f03c => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:05:03.997836 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-051eb4e2-0e3b-4cac-bdda-263004f14177 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:03.998787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-051eb4e2-0e3b-4cac-bdda-263004f14177 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:04.004699 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-051eb4e2-0e3b-4cac-bdda-263004f14177 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:04.005150 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-051eb4e2-0e3b-4cac-bdda-263004f14177 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:04.005964 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-051eb4e2-0e3b-4cac-bdda-263004f14177 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:04.006475 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-051eb4e2-0e3b-4cac-bdda-263004f14177 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:04.040370 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-051eb4e2-0e3b-4cac-bdda-263004f14177 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046839 May 10 14:05:04.040927 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 360/693] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:05:03 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:04.147986 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6a9b9ab6-29a5-46cd-9202-07933b028166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:04.148591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-6a9b9ab6-29a5-46cd-9202-07933b028166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:04.154721 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6a9b9ab6-29a5-46cd-9202-07933b028166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:04.155175 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6a9b9ab6-29a5-46cd-9202-07933b028166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:04.155946 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6a9b9ab6-29a5-46cd-9202-07933b028166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:04.156429 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6a9b9ab6-29a5-46cd-9202-07933b028166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:04.233351 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-6a9b9ab6-29a5-46cd-9202-07933b028166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lazy-loading 'services' on Instance uuid 2a730d46-5e87-4a26-a9fc-4486e99bcf5a {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:05:04.301434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6a9b9ab6-29a5-46cd-9202-07933b028166 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments/6e2e3ed9-e4df-4cde-b96b-ab6c909a1e3b" status: 202 len: 0 microversion: 2.1 time: 0.158305 May 10 14:05:04.302015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 334/694] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 14:05:04 2022] DELETE /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments/6e2e3ed9-e4df-4cde-b96b-ab6c909a1e3b => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:05:04.310559 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a6d4a02b-0fa4-45cc-a8d4-4d5c9792f0ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:04.311769 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a6d4a02b-0fa4-45cc-a8d4-4d5c9792f0ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:04.318226 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a6d4a02b-0fa4-45cc-a8d4-4d5c9792f0ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:04.318675 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a6d4a02b-0fa4-45cc-a8d4-4d5c9792f0ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:04.319444 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a6d4a02b-0fa4-45cc-a8d4-4d5c9792f0ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:04.319883 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a6d4a02b-0fa4-45cc-a8d4-4d5c9792f0ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:04.348680 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a6d4a02b-0fa4-45cc-a8d4-4d5c9792f0ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041555 May 10 14:05:04.349142 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 361/695] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:05:04 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:04.474343 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-57091565-aac6-45a3-9ba9-822767f6237c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:04.475061 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-57091565-aac6-45a3-9ba9-822767f6237c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:04.481198 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-57091565-aac6-45a3-9ba9-822767f6237c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:04.481642 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-57091565-aac6-45a3-9ba9-822767f6237c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:04.482400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-57091565-aac6-45a3-9ba9-822767f6237c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:04.482831 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-57091565-aac6-45a3-9ba9-822767f6237c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:04.611025 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-57091565-aac6-45a3-9ba9-822767f6237c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:04.618883 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-57091565-aac6-45a3-9ba9-822767f6237c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1361 microversion: 2.1 time: 0.149699 May 10 14:05:04.619452 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 335/696] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:04 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:05.052417 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-147d694b-4fa9-4788-9f35-13c34bc37edf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:05.053364 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-147d694b-4fa9-4788-9f35-13c34bc37edf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:05.060500 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-147d694b-4fa9-4788-9f35-13c34bc37edf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:05.060955 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-147d694b-4fa9-4788-9f35-13c34bc37edf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:05.061755 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-147d694b-4fa9-4788-9f35-13c34bc37edf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:05.062194 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-147d694b-4fa9-4788-9f35-13c34bc37edf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:05.090135 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-147d694b-4fa9-4788-9f35-13c34bc37edf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042016 May 10 14:05:05.090694 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 362/697] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:05:05 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:05.360086 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0bdaa238-f84c-4d45-9436-29096bb3d33b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:05.361290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0bdaa238-f84c-4d45-9436-29096bb3d33b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:05.368473 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0bdaa238-f84c-4d45-9436-29096bb3d33b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:05.369063 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0bdaa238-f84c-4d45-9436-29096bb3d33b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:05.369834 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0bdaa238-f84c-4d45-9436-29096bb3d33b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:05.370271 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0bdaa238-f84c-4d45-9436-29096bb3d33b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:05.400950 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0bdaa238-f84c-4d45-9436-29096bb3d33b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044724 May 10 14:05:05.401512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 336/698] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:05:05 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:05.634761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-20ed9f32-a39f-48f9-9638-a32b9bc733f5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:05.635368 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-20ed9f32-a39f-48f9-9638-a32b9bc733f5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:05.641309 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-20ed9f32-a39f-48f9-9638-a32b9bc733f5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:05.641835 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-20ed9f32-a39f-48f9-9638-a32b9bc733f5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:05.642610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-20ed9f32-a39f-48f9-9638-a32b9bc733f5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:05.643046 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-20ed9f32-a39f-48f9-9638-a32b9bc733f5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:05.768284 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-20ed9f32-a39f-48f9-9638-a32b9bc733f5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:05.776153 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-20ed9f32-a39f-48f9-9638-a32b9bc733f5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1546 microversion: 2.1 time: 0.145245 May 10 14:05:05.776739 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 363/699] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:05 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1546 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:05.792510 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c9d0b470-4061-4200-81ae-d70ff3119230 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:05.793009 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c9d0b470-4061-4200-81ae-d70ff3119230 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:05.799161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9d0b470-4061-4200-81ae-d70ff3119230 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:05.799606 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9d0b470-4061-4200-81ae-d70ff3119230 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:05.800406 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9d0b470-4061-4200-81ae-d70ff3119230 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:05.800845 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c9d0b470-4061-4200-81ae-d70ff3119230 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:05.873974 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c9d0b470-4061-4200-81ae-d70ff3119230 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.085183 May 10 14:05:05.874569 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 337/700] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 14:05:05 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-interface => generated 284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:06.101778 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-fcb732d1-f174-4c3d-acee-60b862492a07 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:06.102879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-fcb732d1-f174-4c3d-acee-60b862492a07 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:06.109265 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fcb732d1-f174-4c3d-acee-60b862492a07 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:06.109911 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fcb732d1-f174-4c3d-acee-60b862492a07 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:06.110763 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fcb732d1-f174-4c3d-acee-60b862492a07 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:06.111219 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fcb732d1-f174-4c3d-acee-60b862492a07 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:06.142439 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-fcb732d1-f174-4c3d-acee-60b862492a07 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044319 May 10 14:05:06.143219 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 364/701] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:05:06 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:05:06.203508 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9e01003c-e699-4acc-86ea-ee28b26a5ccd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:06.204008 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9e01003c-e699-4acc-86ea-ee28b26a5ccd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:06.210099 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e01003c-e699-4acc-86ea-ee28b26a5ccd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:06.210532 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e01003c-e699-4acc-86ea-ee28b26a5ccd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:06.211423 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e01003c-e699-4acc-86ea-ee28b26a5ccd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:06.211858 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e01003c-e699-4acc-86ea-ee28b26a5ccd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:06.236226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9e01003c-e699-4acc-86ea-ee28b26a5ccd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Going to try to terminate instance {{(pid=117153) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:05:06.312713 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9e01003c-e699-4acc-86ea-ee28b26a5ccd tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 204 len: 0 microversion: 2.1 time: 0.112369 May 10 14:05:06.313493 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 338/702] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:05:06 2022] DELETE /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:05:06.321582 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-6d735fcf-3bcb-4ef5-ae58-a8ab12232818 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:06.322405 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-6d735fcf-3bcb-4ef5-ae58-a8ab12232818 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:06.328150 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6d735fcf-3bcb-4ef5-ae58-a8ab12232818 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:06.329438 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6d735fcf-3bcb-4ef5-ae58-a8ab12232818 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:06.330579 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6d735fcf-3bcb-4ef5-ae58-a8ab12232818 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:06.331170 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6d735fcf-3bcb-4ef5-ae58-a8ab12232818 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:06.414004 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4fe9bcaa-699f-402c-8759-fd721e808f45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:06.415130 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4fe9bcaa-699f-402c-8759-fd721e808f45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:06.422487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4fe9bcaa-699f-402c-8759-fd721e808f45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:06.423215 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4fe9bcaa-699f-402c-8759-fd721e808f45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:06.424295 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4fe9bcaa-699f-402c-8759-fd721e808f45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:06.425005 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4fe9bcaa-699f-402c-8759-fd721e808f45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:06.458148 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4fe9bcaa-699f-402c-8759-fd721e808f45 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048687 May 10 14:05:06.463512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 339/703] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:05:06 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:06.467149 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-6d735fcf-3bcb-4ef5-ae58-a8ab12232818 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:06.474580 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-6d735fcf-3bcb-4ef5-ae58-a8ab12232818 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1682 microversion: 2.1 time: 0.156781 May 10 14:05:06.475152 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 365/704] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:06 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:07.134275 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-4477bcfd-df07-4fda-81d6-5237733802f9 req-8fa47700-388a-4ff9-963b-f78e25ebe4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e15393-bc14-4433-b2aa-6d8fb202b9ea", "tag": "4bee32e6-d54c-4a5f-8e31-b4e7945065bc"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:07.142506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-4477bcfd-df07-4fda-81d6-5237733802f9 req-8fa47700-388a-4ff9-963b-f78e25ebe4b5 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:07.142945 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-4477bcfd-df07-4fda-81d6-5237733802f9 req-8fa47700-388a-4ff9-963b-f78e25ebe4b5 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:07.154637 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-4477bcfd-df07-4fda-81d6-5237733802f9 req-8fa47700-388a-4ff9-963b-f78e25ebe4b5 service nova] Creating event network-changed:4bee32e6-d54c-4a5f-8e31-b4e7945065bc for instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea on hv-cinder-84067 May 10 14:05:07.159396 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-4477bcfd-df07-4fda-81d6-5237733802f9 req-8fa47700-388a-4ff9-963b-f78e25ebe4b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028822 May 10 14:05:07.159988 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 340/705] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:07.471208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a6872454-b59d-41e4-8b35-deff85dc63b6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:07.472364 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a6872454-b59d-41e4-8b35-deff85dc63b6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:07.478787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a6872454-b59d-41e4-8b35-deff85dc63b6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:07.479237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a6872454-b59d-41e4-8b35-deff85dc63b6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:07.480006 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a6872454-b59d-41e4-8b35-deff85dc63b6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:07.480472 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a6872454-b59d-41e4-8b35-deff85dc63b6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:07.491474 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-78e953e3-b1e3-4e44-9f90-accd9135622f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:07.492195 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-78e953e3-b1e3-4e44-9f90-accd9135622f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:07.498699 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-78e953e3-b1e3-4e44-9f90-accd9135622f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:07.499361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-78e953e3-b1e3-4e44-9f90-accd9135622f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:07.500147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-78e953e3-b1e3-4e44-9f90-accd9135622f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:07.500620 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-78e953e3-b1e3-4e44-9f90-accd9135622f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:07.511624 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a6872454-b59d-41e4-8b35-deff85dc63b6 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044185 May 10 14:05:07.512226 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 366/706] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:05:07 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:07.631615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-78e953e3-b1e3-4e44-9f90-accd9135622f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:07.631802 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-edccda91-76d9-40a3-bba0-61852328efda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:07.632189 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-edccda91-76d9-40a3-bba0-61852328efda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:07.638715 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-edccda91-76d9-40a3-bba0-61852328efda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:07.639171 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-edccda91-76d9-40a3-bba0-61852328efda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:07.639959 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-edccda91-76d9-40a3-bba0-61852328efda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:07.640434 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-edccda91-76d9-40a3-bba0-61852328efda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:07.641406 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-78e953e3-b1e3-4e44-9f90-accd9135622f tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1682 microversion: 2.1 time: 0.154332 May 10 14:05:07.644416 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 341/707] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:07 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:07.667687 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-edccda91-76d9-40a3-bba0-61852328efda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Going to try to terminate instance {{(pid=117154) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:05:07.744333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-edccda91-76d9-40a3-bba0-61852328efda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 204 len: 0 microversion: 2.1 time: 0.116436 May 10 14:05:07.747905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 367/708] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:05:07 2022] DELETE /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 14:05:07.760210 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-da6dabc8-590e-4ecd-87d9-b6c3667464c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:07.760890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-da6dabc8-590e-4ecd-87d9-b6c3667464c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:07.767969 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-da6dabc8-590e-4ecd-87d9-b6c3667464c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:07.768454 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-da6dabc8-590e-4ecd-87d9-b6c3667464c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:07.769505 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-da6dabc8-590e-4ecd-87d9-b6c3667464c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:07.770464 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-da6dabc8-590e-4ecd-87d9-b6c3667464c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:07.901990 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-da6dabc8-590e-4ecd-87d9-b6c3667464c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:07.909319 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-da6dabc8-590e-4ecd-87d9-b6c3667464c0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1577 microversion: 2.1 time: 0.157887 May 10 14:05:07.909895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 342/709] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:07 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:08.524636 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3e84e62b-d10e-48bb-bac9-f962b422c3e9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:08.525586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3e84e62b-d10e-48bb-bac9-f962b422c3e9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:08.531871 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3e84e62b-d10e-48bb-bac9-f962b422c3e9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:08.532364 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3e84e62b-d10e-48bb-bac9-f962b422c3e9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:08.533125 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3e84e62b-d10e-48bb-bac9-f962b422c3e9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:08.533563 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3e84e62b-d10e-48bb-bac9-f962b422c3e9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:08.561709 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3e84e62b-d10e-48bb-bac9-f962b422c3e9 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042044 May 10 14:05:08.562255 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 368/710] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:05:08 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:08.661060 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-00a09321-6e4c-4b6b-8b33-7c0cfa6f45ae tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:08.661677 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-00a09321-6e4c-4b6b-8b33-7c0cfa6f45ae tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:08.667975 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-00a09321-6e4c-4b6b-8b33-7c0cfa6f45ae tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:08.668458 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-00a09321-6e4c-4b6b-8b33-7c0cfa6f45ae tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:08.669232 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-00a09321-6e4c-4b6b-8b33-7c0cfa6f45ae tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:08.669675 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-00a09321-6e4c-4b6b-8b33-7c0cfa6f45ae tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:08.792539 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-00a09321-6e4c-4b6b-8b33-7c0cfa6f45ae tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:08.799749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-00a09321-6e4c-4b6b-8b33-7c0cfa6f45ae tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1682 microversion: 2.1 time: 0.143158 May 10 14:05:08.800348 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 343/711] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:08 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1682 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:08.926864 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-02abda40-d761-44d1-88be-4b11237f2668 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:08.927474 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-02abda40-d761-44d1-88be-4b11237f2668 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:08.933394 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-02abda40-d761-44d1-88be-4b11237f2668 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:08.933839 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-02abda40-d761-44d1-88be-4b11237f2668 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:08.934596 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-02abda40-d761-44d1-88be-4b11237f2668 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:08.935026 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-02abda40-d761-44d1-88be-4b11237f2668 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:09.067546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-02abda40-d761-44d1-88be-4b11237f2668 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:09.075193 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-02abda40-d761-44d1-88be-4b11237f2668 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1577 microversion: 2.1 time: 0.152123 May 10 14:05:09.075768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 369/712] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:08 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:09.573664 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-514b364c-d751-4210-8b36-47ec2f00e6b2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:09.574238 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-514b364c-d751-4210-8b36-47ec2f00e6b2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:09.580352 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-514b364c-d751-4210-8b36-47ec2f00e6b2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:09.580802 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-514b364c-d751-4210-8b36-47ec2f00e6b2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:09.581574 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-514b364c-d751-4210-8b36-47ec2f00e6b2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:09.582011 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-514b364c-d751-4210-8b36-47ec2f00e6b2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:09.613477 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-514b364c-d751-4210-8b36-47ec2f00e6b2 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044147 May 10 14:05:09.619161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 344/713] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:05:09 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:05:09.688016 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c9d2d271-96af-4f0f-8bef-844eaf1fda38 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:09.688588 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c9d2d271-96af-4f0f-8bef-844eaf1fda38 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:09.695208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c9d2d271-96af-4f0f-8bef-844eaf1fda38 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:09.695730 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c9d2d271-96af-4f0f-8bef-844eaf1fda38 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:09.696777 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c9d2d271-96af-4f0f-8bef-844eaf1fda38 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:09.697279 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c9d2d271-96af-4f0f-8bef-844eaf1fda38 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:09.725411 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c9d2d271-96af-4f0f-8bef-844eaf1fda38 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Going to try to terminate instance {{(pid=117154) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:05:09.820114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a748f589-314a-472a-8aa3-9620639f9338 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:09.821527 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a748f589-314a-472a-8aa3-9620639f9338 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:09.823208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c9d2d271-96af-4f0f-8bef-844eaf1fda38 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 204 len: 0 microversion: 2.1 time: 0.138343 May 10 14:05:09.825726 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 370/714] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:05:09 2022] DELETE /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:05:09.834720 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-b2ac56ec-800f-4df8-bdcb-6b07dd41b587 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:09.834963 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a748f589-314a-472a-8aa3-9620639f9338 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:09.835391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a748f589-314a-472a-8aa3-9620639f9338 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:09.835897 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-b2ac56ec-800f-4df8-bdcb-6b07dd41b587 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:09.836197 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a748f589-314a-472a-8aa3-9620639f9338 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:09.841132 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a748f589-314a-472a-8aa3-9620639f9338 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:09.844976 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b2ac56ec-800f-4df8-bdcb-6b07dd41b587 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:09.845723 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b2ac56ec-800f-4df8-bdcb-6b07dd41b587 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:09.847406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b2ac56ec-800f-4df8-bdcb-6b07dd41b587 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:09.848632 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b2ac56ec-800f-4df8-bdcb-6b07dd41b587 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:10.097058 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a748f589-314a-472a-8aa3-9620639f9338 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:10.105350 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a748f589-314a-472a-8aa3-9620639f9338 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1682 microversion: 2.1 time: 0.290245 May 10 14:05:10.113399 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 345/715] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:09 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1682 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:10.113399 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-82e2e7d1-d9b8-4528-8efd-444b405ffa75 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:10.113399 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-82e2e7d1-d9b8-4528-8efd-444b405ffa75 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:10.114263 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-b2ac56ec-800f-4df8-bdcb-6b07dd41b587 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:10.118437 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82e2e7d1-d9b8-4528-8efd-444b405ffa75 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:10.118962 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82e2e7d1-d9b8-4528-8efd-444b405ffa75 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:10.119933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82e2e7d1-d9b8-4528-8efd-444b405ffa75 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:10.120469 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82e2e7d1-d9b8-4528-8efd-444b405ffa75 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:10.128621 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-b2ac56ec-800f-4df8-bdcb-6b07dd41b587 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1688 microversion: 2.1 time: 0.299021 May 10 14:05:10.139506 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 371/716] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:09 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1688 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:10.324324 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-82e2e7d1-d9b8-4528-8efd-444b405ffa75 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:10.331787 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-82e2e7d1-d9b8-4528-8efd-444b405ffa75 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1577 microversion: 2.1 time: 0.224390 May 10 14:05:10.340198 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 346/717] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:10 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:10.607669 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-ecf1b6dd-9b24-4ef8-ab69-173259a467f9 req-3c272244-0097-497f-835b-41c7bf9d23ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2288a3f8-70db-4951-acaf-f839a42ed73b", "name": "network-vif-deleted", "tag": "ec56af2f-6e36-458b-8cbf-61f578a6cae0"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:10.617896 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-ecf1b6dd-9b24-4ef8-ab69-173259a467f9 req-3c272244-0097-497f-835b-41c7bf9d23ff service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:10.618427 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-ecf1b6dd-9b24-4ef8-ab69-173259a467f9 req-3c272244-0097-497f-835b-41c7bf9d23ff service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:10.634950 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-ecf1b6dd-9b24-4ef8-ab69-173259a467f9 req-3c272244-0097-497f-835b-41c7bf9d23ff service nova] Creating event network-vif-deleted:ec56af2f-6e36-458b-8cbf-61f578a6cae0 for instance 2288a3f8-70db-4951-acaf-f839a42ed73b on hv-cinder-84067 May 10 14:05:10.642992 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-ecf1b6dd-9b24-4ef8-ab69-173259a467f9 req-3c272244-0097-497f-835b-41c7bf9d23ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039474 May 10 14:05:10.644163 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 372/718] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:10.675035 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-fc60e924-fa60-4a3e-a552-c4636d58818b req-6cdf9e51-6b99-4ba3-a1f4-ac2b565a0040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ade9bf-f1d4-454c-928b-bb882c680d30", "name": "network-vif-deleted", "tag": "41e1a591-ff64-4acf-8e49-bb32771685e9"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:10.685463 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-fc60e924-fa60-4a3e-a552-c4636d58818b req-6cdf9e51-6b99-4ba3-a1f4-ac2b565a0040 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:10.686200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-fc60e924-fa60-4a3e-a552-c4636d58818b req-6cdf9e51-6b99-4ba3-a1f4-ac2b565a0040 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:10.700006 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-fc60e924-fa60-4a3e-a552-c4636d58818b req-6cdf9e51-6b99-4ba3-a1f4-ac2b565a0040 service nova] Creating event network-vif-deleted:41e1a591-ff64-4acf-8e49-bb32771685e9 for instance 61ade9bf-f1d4-454c-928b-bb882c680d30 on hv-cinder-84067 May 10 14:05:10.705391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-fc60e924-fa60-4a3e-a552-c4636d58818b req-6cdf9e51-6b99-4ba3-a1f4-ac2b565a0040 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034167 May 10 14:05:10.706451 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 347/719] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:11.124029 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5e392a4b-fb59-4ab2-9400-5b19f25a705e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:11.124880 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5e392a4b-fb59-4ab2-9400-5b19f25a705e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:11.131376 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5e392a4b-fb59-4ab2-9400-5b19f25a705e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:11.131823 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5e392a4b-fb59-4ab2-9400-5b19f25a705e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:11.132614 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5e392a4b-fb59-4ab2-9400-5b19f25a705e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:11.133215 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5e392a4b-fb59-4ab2-9400-5b19f25a705e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:11.147318 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d8269cae-77fc-4c81-85a5-0bffa781dd8f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:11.148019 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d8269cae-77fc-4c81-85a5-0bffa781dd8f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:11.162799 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d8269cae-77fc-4c81-85a5-0bffa781dd8f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:11.163946 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d8269cae-77fc-4c81-85a5-0bffa781dd8f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:11.165544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d8269cae-77fc-4c81-85a5-0bffa781dd8f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:11.166184 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d8269cae-77fc-4c81-85a5-0bffa781dd8f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:11.221327 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5e392a4b-fb59-4ab2-9400-5b19f25a705e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:11.229754 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5e392a4b-fb59-4ab2-9400-5b19f25a705e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1615 microversion: 2.1 time: 0.110448 May 10 14:05:11.240187 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 373/720] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:11 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1615 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:11.317056 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d8269cae-77fc-4c81-85a5-0bffa781dd8f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:11.324411 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d8269cae-77fc-4c81-85a5-0bffa781dd8f tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1688 microversion: 2.1 time: 0.181981 May 10 14:05:11.324987 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 348/721] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:11 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:11.351047 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5673f172-8b56-4735-8254-b1659addc250 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:11.351637 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5673f172-8b56-4735-8254-b1659addc250 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:11.359492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5673f172-8b56-4735-8254-b1659addc250 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:11.359976 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5673f172-8b56-4735-8254-b1659addc250 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:11.360794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5673f172-8b56-4735-8254-b1659addc250 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:11.361232 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5673f172-8b56-4735-8254-b1659addc250 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:11.433615 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5673f172-8b56-4735-8254-b1659addc250 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:11.441933 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5673f172-8b56-4735-8254-b1659addc250 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1510 microversion: 2.1 time: 0.096014 May 10 14:05:11.442889 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 374/722] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:11 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1510 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:12.246946 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bb905951-93b4-45eb-af20-c704776d75f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:12.247473 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bb905951-93b4-45eb-af20-c704776d75f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:12.253891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bb905951-93b4-45eb-af20-c704776d75f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:12.254930 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bb905951-93b4-45eb-af20-c704776d75f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:12.255689 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bb905951-93b4-45eb-af20-c704776d75f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:12.256122 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bb905951-93b4-45eb-af20-c704776d75f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:12.315920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bb905951-93b4-45eb-af20-c704776d75f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:12.323690 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bb905951-93b4-45eb-af20-c704776d75f8 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1615 microversion: 2.1 time: 0.080727 May 10 14:05:12.324279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 349/723] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:12 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1615 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:12.341426 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0800683c-0bcb-4e38-8367-8a02946a5561 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:12.342045 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0800683c-0bcb-4e38-8367-8a02946a5561 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:12.348469 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0800683c-0bcb-4e38-8367-8a02946a5561 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:12.348926 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0800683c-0bcb-4e38-8367-8a02946a5561 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:12.349700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0800683c-0bcb-4e38-8367-8a02946a5561 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:12.350143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0800683c-0bcb-4e38-8367-8a02946a5561 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:12.458923 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-75cd7b1f-3653-4aad-9d9b-44a0763c8b31 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:12.459527 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-75cd7b1f-3653-4aad-9d9b-44a0763c8b31 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:12.465368 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-75cd7b1f-3653-4aad-9d9b-44a0763c8b31 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:12.465822 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-75cd7b1f-3653-4aad-9d9b-44a0763c8b31 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:12.466599 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-75cd7b1f-3653-4aad-9d9b-44a0763c8b31 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:12.467046 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-75cd7b1f-3653-4aad-9d9b-44a0763c8b31 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:12.476928 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0800683c-0bcb-4e38-8367-8a02946a5561 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:12.484306 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0800683c-0bcb-4e38-8367-8a02946a5561 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1688 microversion: 2.1 time: 0.146606 May 10 14:05:12.484994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 375/724] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:12 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1688 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:12.528623 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-75cd7b1f-3653-4aad-9d9b-44a0763c8b31 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:12.536831 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-75cd7b1f-3653-4aad-9d9b-44a0763c8b31 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1510 microversion: 2.1 time: 0.081670 May 10 14:05:12.537430 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 350/725] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:12 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1510 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:13.340489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bbfbf633-afb9-4ea3-938a-b44dff4839b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:13.341012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-bbfbf633-afb9-4ea3-938a-b44dff4839b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:13.347110 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bbfbf633-afb9-4ea3-938a-b44dff4839b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:13.348239 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bbfbf633-afb9-4ea3-938a-b44dff4839b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:13.348824 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bbfbf633-afb9-4ea3-938a-b44dff4839b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:13.349253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bbfbf633-afb9-4ea3-938a-b44dff4839b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:13.380064 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bbfbf633-afb9-4ea3-938a-b44dff4839b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:13.380544 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bbfbf633-afb9-4ea3-938a-b44dff4839b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:13.380995 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-bbfbf633-afb9-4ea3-938a-b44dff4839b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lazy-loading 'fault' on Instance uuid 61ade9bf-f1d4-454c-928b-bb882c680d30 {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:05:13.439097 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-bbfbf633-afb9-4ea3-938a-b44dff4839b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:13.447426 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-bbfbf633-afb9-4ea3-938a-b44dff4839b6 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 200 len: 1332 microversion: 2.1 time: 0.110779 May 10 14:05:13.448012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 376/726] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:13 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:13.502274 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ca3ea3c6-a89b-4e75-8b12-db6796d233ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:13.502941 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ca3ea3c6-a89b-4e75-8b12-db6796d233ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:13.510052 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ca3ea3c6-a89b-4e75-8b12-db6796d233ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:13.510537 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ca3ea3c6-a89b-4e75-8b12-db6796d233ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:13.511316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ca3ea3c6-a89b-4e75-8b12-db6796d233ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:13.511926 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ca3ea3c6-a89b-4e75-8b12-db6796d233ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:13.554198 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-36156cb5-3be3-4de2-bb50-5ee39b05c86c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:13.554801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-36156cb5-3be3-4de2-bb50-5ee39b05c86c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:13.560679 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-36156cb5-3be3-4de2-bb50-5ee39b05c86c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:13.561127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-36156cb5-3be3-4de2-bb50-5ee39b05c86c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:13.561900 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-36156cb5-3be3-4de2-bb50-5ee39b05c86c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:13.562336 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-36156cb5-3be3-4de2-bb50-5ee39b05c86c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:13.622012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-36156cb5-3be3-4de2-bb50-5ee39b05c86c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:13.629289 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-36156cb5-3be3-4de2-bb50-5ee39b05c86c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 200 len: 1225 microversion: 2.1 time: 0.079380 May 10 14:05:13.630076 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 377/727] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:13 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:13.639785 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ca3ea3c6-a89b-4e75-8b12-db6796d233ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:13.647516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ca3ea3c6-a89b-4e75-8b12-db6796d233ed tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1688 microversion: 2.1 time: 0.149258 May 10 14:05:13.648091 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 351/728] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:13 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:14.465866 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-76e7afa5-7b8a-4457-bfb1-f5ba6dccba3c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:14.466464 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-76e7afa5-7b8a-4457-bfb1-f5ba6dccba3c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:14.472351 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-76e7afa5-7b8a-4457-bfb1-f5ba6dccba3c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:14.472811 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-76e7afa5-7b8a-4457-bfb1-f5ba6dccba3c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:14.473579 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-76e7afa5-7b8a-4457-bfb1-f5ba6dccba3c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:14.474016 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-76e7afa5-7b8a-4457-bfb1-f5ba6dccba3c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:14.487115 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-76e7afa5-7b8a-4457-bfb1-f5ba6dccba3c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-76e7afa5-7b8a-4457-bfb1-f5ba6dccba3c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 HTTP/1.1 May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:05:14.489221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:05:14.490751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:05:14.490751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:05:14.490751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:05:14.490751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:05:14.490751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:05:14.490751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:05:14.490751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:05:14.490751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:05:14.490751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:05:14.490751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:05:14.490751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:05:14.490751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '61ade9bf-f1d4-454c-928b-bb882c680d30'} May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:05:14.491610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:05:14.492869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:14.493915 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-76e7afa5-7b8a-4457-bfb1-f5ba6dccba3c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 404 to user: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:05:14.493915 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-76e7afa5-7b8a-4457-bfb1-f5ba6dccba3c tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 404 len: 111 microversion: 2.1 time: 0.029591 May 10 14:05:14.493915 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 378/729] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:14 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:05:14.499282 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-89d27fb4-4abf-4ced-a7d3-1d08f718038a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '.version_select at 0x7f5f7c038700>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:14.522732 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-89d27fb4-4abf-4ced-a7d3-1d08f718038a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813450794" status: 202 len: 0 microversion: 2.1 time: 0.027030 May 10 14:05:14.526550 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 352/730] 10.222.0.49 () {58 vars in 1220 bytes} [Tue May 10 14:05:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813450794 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:05:14.571708 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-9aceebbf-c7dc-4697-8c3e-70b7187ceef3 req-9b225a96-15bc-42ce-879c-340046d0b6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a730d46-5e87-4a26-a9fc-4486e99bcf5a", "name": "network-vif-deleted", "tag": "f2587919-e230-4e3a-8926-a6478337a26a"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:14.581349 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-9aceebbf-c7dc-4697-8c3e-70b7187ceef3 req-9b225a96-15bc-42ce-879c-340046d0b6e3 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:14.582452 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-9aceebbf-c7dc-4697-8c3e-70b7187ceef3 req-9b225a96-15bc-42ce-879c-340046d0b6e3 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:14.597487 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-9aceebbf-c7dc-4697-8c3e-70b7187ceef3 req-9b225a96-15bc-42ce-879c-340046d0b6e3 service nova] Creating event network-vif-deleted:f2587919-e230-4e3a-8926-a6478337a26a for instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a on hv-cinder-84067 May 10 14:05:14.603527 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-9aceebbf-c7dc-4697-8c3e-70b7187ceef3 req-9b225a96-15bc-42ce-879c-340046d0b6e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036645 May 10 14:05:14.604879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 379/731] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:05:14.647858 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ab46eef9-109c-426c-80a4-4f4ffa5423ba tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:14.648499 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ab46eef9-109c-426c-80a4-4f4ffa5423ba tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:14.655361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ab46eef9-109c-426c-80a4-4f4ffa5423ba tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:14.655823 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ab46eef9-109c-426c-80a4-4f4ffa5423ba tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:14.656633 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ab46eef9-109c-426c-80a4-4f4ffa5423ba tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:14.657074 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ab46eef9-109c-426c-80a4-4f4ffa5423ba tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:14.664998 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1c9f1d0f-4894-427c-9a52-fae8e2e0543b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:14.665986 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1c9f1d0f-4894-427c-9a52-fae8e2e0543b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:14.675262 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1c9f1d0f-4894-427c-9a52-fae8e2e0543b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:14.677054 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1c9f1d0f-4894-427c-9a52-fae8e2e0543b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:14.678021 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1c9f1d0f-4894-427c-9a52-fae8e2e0543b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:14.679884 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1c9f1d0f-4894-427c-9a52-fae8e2e0543b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:14.690231 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-ab46eef9-109c-426c-80a4-4f4ffa5423ba tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] HTTP exception thrown: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ab46eef9-109c-426c-80a4-4f4ffa5423ba tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Request method failure captured: May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b HTTP/1.1 May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABienA71HtoIk-GqBMgFliyJhCDwZfIHlboG5nza-Cssw4HihcBMb0ADd-LikkHL831Qlg0OEwRJ-BXtS4KlrS_jM36DS-HVOT404UCXRk99pFgoA8ewTtmBYCLxEro9-qCFBPrgWBvARKkCB3Uf-xf7cE9Dx4pynfGe43xPMGSOfiWWpU May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 104740054c3a47ca8cc3cb262d975fd5 May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-TestVolumeBootPattern-253187725 May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:05:14.702421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:05:14.704084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:05:14.704084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-TestVolumeBootPattern-253187725 May 10 14:05:14.704084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 104740054c3a47ca8cc3cb262d975fd5 May 10 14:05:14.704084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-TestVolumeBootPattern-253187725 May 10 14:05:14.704084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-TestVolumeBootPattern-253187725-project May 10 14:05:14.704084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:05:14.704084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:05:14.704084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 9d87a4de3fbf4cbb9e21523634007629 May 10 14:05:14.704084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-TestVolumeBootPattern-253187725-project May 10 14:05:14.704084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:05:14.704084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:05:14.704084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '2288a3f8-70db-4951-acaf-f839a42ed73b'} May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:05:14.706706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:05:14.708964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:05:14.710225 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ab46eef9-109c-426c-80a4-4f4ffa5423ba tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Returning 404 to user: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:05:14.710860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ab46eef9-109c-426c-80a4-4f4ffa5423ba tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 404 len: 111 microversion: 2.1 time: 0.063165 May 10 14:05:14.720367 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 353/732] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:14 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:05:14.845267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-609248729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-379745293", "security_groups": [{"name": "tempest-secgroup-smoke-821776293"}], "block_device_mapping_v2": [{"uuid": "57425500-6067-4c08-b7aa-7e37ffa46c4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3ef3499-58c5-4573-b70a-3147dbe30f92"}]}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:14.951474 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1c9f1d0f-4894-427c-9a52-fae8e2e0543b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:14.958958 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1c9f1d0f-4894-427c-9a52-fae8e2e0543b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 200 len: 1330 microversion: 2.1 time: 0.298100 May 10 14:05:14.959803 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 380/733] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:14 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 1330 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:14.987696 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.network.neutron [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] validate_networks() for [('c3ef3499-58c5-4573-b70a-3147dbe30f92', None, None, None, None, None)] {{(pid=117153) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:05:15.398036 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8ceeaaa2-33ec-4bab-bead-a66ae9746597 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: .version_select at 0x7f5f80286310>, body: {"keypair": {"name": "tempest-keypair-1277131625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGzpwVZVZFMkP6VEM/H/aIrI9ulDJkdV0PoeJ674kgoNLeZUVwQRIdpCvHSIKP9F4xlxjfj9p9uABe6gJuJBzHQJmCdKmLoyg5ZVZfxaWDAVTVSpgJI3h9r1yEUQggaCQ=="}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:15.413270 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-8ceeaaa2-33ec-4bab-bead-a66ae9746597 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'key_pairs'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:05:15.417211 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-8ceeaaa2-33ec-4bab-bead-a66ae9746597 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for user 8c563c6a229b4e619992ccfb0da1a748 and project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'key_pairs'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:05:15.445051 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8ceeaaa2-33ec-4bab-bead-a66ae9746597 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051145 May 10 14:05:15.447642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 381/734] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 14:05:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:05:15.489639 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Flavor limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:05:15.490258 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Image limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:05:15.490805 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Flavor pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:05:15.491290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Image pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:05:15.491775 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:05:15.500651 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:15.501097 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:15.501946 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:15.502584 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:15.521428 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Getting quotas for project 104740054c3a47ca8cc3cb262d975fd5. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:05:15.525718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Getting quotas for user 9d87a4de3fbf4cbb9e21523634007629 and project 104740054c3a47ca8cc3cb262d975fd5. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:05:15.587414 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Going to run 1 instances... {{(pid=117153) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:05:15.588738 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57425500-6067-4c08-b7aa-7e37ffa46c4e',volume_size=None,volume_type=None)] {{(pid=117153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:05:15.759318 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8c22f69c-d318-445e-a3f7-962e8b1b3c8f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.918068 May 10 14:05:15.760038 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 354/735] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:05:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 14:05:15.770848 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-dac2fb11-2a83-4aef-b2b5-fc45a99a54ab tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:15.771530 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-dac2fb11-2a83-4aef-b2b5-fc45a99a54ab tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:15.832815 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-dac2fb11-2a83-4aef-b2b5-fc45a99a54ab tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:15.842563 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-dac2fb11-2a83-4aef-b2b5-fc45a99a54ab tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1093 microversion: 2.1 time: 0.075583 May 10 14:05:15.844632 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 382/736] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:15 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:15.975851 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e7343f08-e6b7-4308-ade2-90ba340ad40e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:15.976564 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e7343f08-e6b7-4308-ade2-90ba340ad40e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 2a730d46-5e87-4a26-a9fc-4486e99bcf5a] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:15.983836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e7343f08-e6b7-4308-ade2-90ba340ad40e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:15.984446 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e7343f08-e6b7-4308-ade2-90ba340ad40e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:15.985489 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e7343f08-e6b7-4308-ade2-90ba340ad40e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:15.986221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e7343f08-e6b7-4308-ade2-90ba340ad40e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:16.003895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-e7343f08-e6b7-4308-ade2-90ba340ad40e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] HTTP exception thrown: Instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a could not be found. May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e7343f08-e6b7-4308-ade2-90ba340ad40e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Request method failure captured: May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a HTTP/1.1 May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_xDu6JK8pwUvXha8KU8vHpKnPJ5AHhm1By_XEE5j72JnoFzaYxegH6ZsuxN4FWA1raNtM_ROxaWfY0nbamU8BT7VWF1Y7WMNmjHep8IOoIxRuQKI3XGxdDGrNRZkarxHVxP2Sbt7uY3g2tkENQuSC7H9HTviVk1BNO3aP-ni1o7Qs May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 368287ad726146f88559c73a86e4b26d May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:05:16.005751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:05:16.007383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/368287ad726146f88559c73a86e4b26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_368287ad726146f88559c73a86e4b26d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/368287ad726146f88559c73a86e4b26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/368287ad726146f88559c73a86e4b26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:05:16.007383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:05:16.007383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 368287ad726146f88559c73a86e4b26d May 10 14:05:16.007383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:05:16.007383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-ServerRescueNegativeTestJSON-1855127385-project May 10 14:05:16.007383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:05:16.007383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:05:16.007383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: bd14de0fd51c4fd89d9875b9c47100cc May 10 14:05:16.007383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855127385-project May 10 14:05:16.007383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:05:16.007383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a could not be found. May 10 14:05:16.007383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '2a730d46-5e87-4a26-a9fc-4486e99bcf5a'} May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a could not be found. May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:05:16.008361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a could not be found. May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a could not be found. May 10 14:05:16.009784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:05:16.012402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e7343f08-e6b7-4308-ade2-90ba340ad40e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Returning 404 to user: Instance 2a730d46-5e87-4a26-a9fc-4486e99bcf5a could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:05:16.013500 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e7343f08-e6b7-4308-ade2-90ba340ad40e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a" status: 404 len: 111 microversion: 2.1 time: 0.042597 May 10 14:05:16.014519 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 355/737] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:15 2022] GET /compute/v2.1/servers/2a730d46-5e87-4a26-a9fc-4486e99bcf5a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:05:16.024899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-85dddf62-6519-42e1-8006-b53a89a07a8b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '.version_select at 0x7f5f80301790>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:16.060295 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-85dddf62-6519-42e1-8006-b53a89a07a8b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-821191081" status: 202 len: 0 microversion: 2.1 time: 0.041336 May 10 14:05:16.060887 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 383/738] 10.222.0.49 () {58 vars in 1217 bytes} [Tue May 10 14:05:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-821191081 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:05:16.859879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d2cae07c-f1ed-49b9-8cc2-0698a139cb05 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:16.860575 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d2cae07c-f1ed-49b9-8cc2-0698a139cb05 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:16.867205 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d2cae07c-f1ed-49b9-8cc2-0698a139cb05 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:16.867659 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d2cae07c-f1ed-49b9-8cc2-0698a139cb05 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:16.868533 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d2cae07c-f1ed-49b9-8cc2-0698a139cb05 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:16.868980 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d2cae07c-f1ed-49b9-8cc2-0698a139cb05 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:16.932119 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d2cae07c-f1ed-49b9-8cc2-0698a139cb05 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:16.932811 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2005643763", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c9ceeee-200d-4bc2-b027-788cdb69321a"}], "security_groups": [{"name": "tempest-securitygroup--966638482"}], "key_name": "tempest-keypair-1277131625", "user_data": "}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:16.939627 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d2cae07c-f1ed-49b9-8cc2-0698a139cb05 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1191 microversion: 2.1 time: 0.083656 May 10 14:05:16.940368 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 356/739] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:16 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:17.104786 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] validate_networks() for [('2c9ceeee-200d-4bc2-b027-788cdb69321a', None, None, None, None, None)] {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:05:17.958152 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4bac30d9-5aa9-44c7-ab88-fd3e707f3472 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:17.958768 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4bac30d9-5aa9-44c7-ab88-fd3e707f3472 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:17.965049 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4bac30d9-5aa9-44c7-ab88-fd3e707f3472 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:17.965503 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4bac30d9-5aa9-44c7-ab88-fd3e707f3472 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:17.966278 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4bac30d9-5aa9-44c7-ab88-fd3e707f3472 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:17.966721 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4bac30d9-5aa9-44c7-ab88-fd3e707f3472 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:17.969338 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:05:17.969815 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:05:17.970235 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:05:17.970895 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:05:17.971349 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:05:17.980200 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:17.981080 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:17.982196 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:17.982641 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:18.000032 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:05:18.005458 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Getting quotas for user 8c563c6a229b4e619992ccfb0da1a748 and project e296ee60cdee4a6b9ca754c83b8c9ffd. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:05:18.017804 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:05:18.022237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:05:18.031202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4bac30d9-5aa9-44c7-ab88-fd3e707f3472 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:18.039310 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4bac30d9-5aa9-44c7-ab88-fd3e707f3472 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1197 microversion: 2.1 time: 0.085547 May 10 14:05:18.039913 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 357/740] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:17 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:18.069127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-967b2b15-7d7b-47e0-9cc4-b41be56c41e7 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.141135 May 10 14:05:18.069995 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 384/741] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:05:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 14:05:18.224519 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fd40105e-d63a-47be-aeec-43609296d975 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:18.225202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fd40105e-d63a-47be-aeec-43609296d975 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:18.304851 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-fd40105e-d63a-47be-aeec-43609296d975 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:18.311965 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fd40105e-d63a-47be-aeec-43609296d975 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1242 microversion: 2.1 time: 0.235931 May 10 14:05:18.313719 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 358/742] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:18 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1242 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:19.010519 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-917f6026-956a-4e25-bf66-47f7312372a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:19.011810 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-917f6026-956a-4e25-bf66-47f7312372a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:19.024739 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-63670d5c-41d9-4256-954a-e87578cc46b3 req-2177a97f-37fb-42e2-91cd-381a49f0a40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821e2fc1-0f9b-40f0-a08e-cb87df184140", "tag": "1b71aba5-cc9f-45c9-8184-f38605a005e7"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:19.031257 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-917f6026-956a-4e25-bf66-47f7312372a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:19.032090 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-917f6026-956a-4e25-bf66-47f7312372a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:19.037338 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-63670d5c-41d9-4256-954a-e87578cc46b3 req-2177a97f-37fb-42e2-91cd-381a49f0a40a service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:19.037775 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-63670d5c-41d9-4256-954a-e87578cc46b3 req-2177a97f-37fb-42e2-91cd-381a49f0a40a service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:19.038782 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-917f6026-956a-4e25-bf66-47f7312372a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:19.039311 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-917f6026-956a-4e25-bf66-47f7312372a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:19.053847 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-63670d5c-41d9-4256-954a-e87578cc46b3 req-2177a97f-37fb-42e2-91cd-381a49f0a40a service nova] Creating event network-changed:1b71aba5-cc9f-45c9-8184-f38605a005e7 for instance 821e2fc1-0f9b-40f0-a08e-cb87df184140 on hv-cinder-84067 May 10 14:05:19.059937 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-63670d5c-41d9-4256-954a-e87578cc46b3 req-2177a97f-37fb-42e2-91cd-381a49f0a40a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039168 May 10 14:05:19.061147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 359/743] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:05:19.067730 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f946fd70-e0ea-49be-a7da-c3bbcf214bb1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:19.068674 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f946fd70-e0ea-49be-a7da-c3bbcf214bb1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:19.075650 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f946fd70-e0ea-49be-a7da-c3bbcf214bb1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:19.076342 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f946fd70-e0ea-49be-a7da-c3bbcf214bb1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:19.077725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f946fd70-e0ea-49be-a7da-c3bbcf214bb1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:19.079078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f946fd70-e0ea-49be-a7da-c3bbcf214bb1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:19.091781 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-917f6026-956a-4e25-bf66-47f7312372a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/ips" status: 200 len: 152 microversion: 2.20 time: 0.201126 May 10 14:05:19.106119 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 385/744] 10.222.0.49 () {60 vars in 1288 bytes} [Tue May 10 14:05:18 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/ips => generated 152 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:05:19.309744 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2f17a01b-2a3a-4019-a295-a011188a4a52 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:19.310176 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2f17a01b-2a3a-4019-a295-a011188a4a52 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:19.324493 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2f17a01b-2a3a-4019-a295-a011188a4a52 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:19.325410 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2f17a01b-2a3a-4019-a295-a011188a4a52 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:19.326669 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2f17a01b-2a3a-4019-a295-a011188a4a52 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:19.327345 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2f17a01b-2a3a-4019-a295-a011188a4a52 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:19.341177 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f946fd70-e0ea-49be-a7da-c3bbcf214bb1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:19.352992 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f946fd70-e0ea-49be-a7da-c3bbcf214bb1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1264 microversion: 2.1 time: 0.290399 May 10 14:05:19.353610 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 360/745] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:19 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1264 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:19.358192 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9be5ee36-2dc8-4202-9248-6afdf497c926 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:19.361475 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9be5ee36-2dc8-4202-9248-6afdf497c926 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:19.375611 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9be5ee36-2dc8-4202-9248-6afdf497c926 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:19.383280 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9be5ee36-2dc8-4202-9248-6afdf497c926 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:19.384366 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9be5ee36-2dc8-4202-9248-6afdf497c926 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:19.384951 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9be5ee36-2dc8-4202-9248-6afdf497c926 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:19.417446 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2f17a01b-2a3a-4019-a295-a011188a4a52 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Going to try to terminate instance {{(pid=117154) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:05:19.514416 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9be5ee36-2dc8-4202-9248-6afdf497c926 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:19.522677 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9be5ee36-2dc8-4202-9248-6afdf497c926 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1312 microversion: 2.1 time: 0.168033 May 10 14:05:19.532589 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 361/746] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:19 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:19.578333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2f17a01b-2a3a-4019-a295-a011188a4a52 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 204 len: 0 microversion: 2.1 time: 0.273258 May 10 14:05:19.582902 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 386/747] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:05:19 2022] DELETE /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:05:19.587736 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8b755c0c-1b29-46b3-9d8e-f9a4a1fe0f92 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:19.588375 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8b755c0c-1b29-46b3-9d8e-f9a4a1fe0f92 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:19.595128 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8b755c0c-1b29-46b3-9d8e-f9a4a1fe0f92 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:19.596061 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8b755c0c-1b29-46b3-9d8e-f9a4a1fe0f92 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:19.597440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8b755c0c-1b29-46b3-9d8e-f9a4a1fe0f92 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:19.597943 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8b755c0c-1b29-46b3-9d8e-f9a4a1fe0f92 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:19.804863 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8b755c0c-1b29-46b3-9d8e-f9a4a1fe0f92 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:19.812136 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8b755c0c-1b29-46b3-9d8e-f9a4a1fe0f92 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1507 microversion: 2.1 time: 0.228179 May 10 14:05:19.812735 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 362/748] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:19 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:20.370440 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9e172632-a33c-482a-8a2a-a3082f1c0e4d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:20.371149 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9e172632-a33c-482a-8a2a-a3082f1c0e4d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:20.377448 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9e172632-a33c-482a-8a2a-a3082f1c0e4d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:20.377928 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9e172632-a33c-482a-8a2a-a3082f1c0e4d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:20.379229 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9e172632-a33c-482a-8a2a-a3082f1c0e4d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:20.379673 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9e172632-a33c-482a-8a2a-a3082f1c0e4d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:20.514474 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9e172632-a33c-482a-8a2a-a3082f1c0e4d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:20.521958 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9e172632-a33c-482a-8a2a-a3082f1c0e4d tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1264 microversion: 2.1 time: 0.155840 May 10 14:05:20.522519 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 387/749] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:20 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:20.538643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-72b5c726-1c5e-495e-a665-0fa0d7d6e2ea tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:20.539259 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-72b5c726-1c5e-495e-a665-0fa0d7d6e2ea tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:20.545802 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-72b5c726-1c5e-495e-a665-0fa0d7d6e2ea tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:20.546249 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-72b5c726-1c5e-495e-a665-0fa0d7d6e2ea tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:20.547011 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-72b5c726-1c5e-495e-a665-0fa0d7d6e2ea tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:20.547449 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-72b5c726-1c5e-495e-a665-0fa0d7d6e2ea tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:20.678394 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-72b5c726-1c5e-495e-a665-0fa0d7d6e2ea tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:20.685814 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-72b5c726-1c5e-495e-a665-0fa0d7d6e2ea tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1367 microversion: 2.1 time: 0.150924 May 10 14:05:20.686389 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 363/750] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:20 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:20.829855 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-38495e83-5166-4d9b-8f9a-de3a93b80261 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:20.830472 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-38495e83-5166-4d9b-8f9a-de3a93b80261 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:20.836573 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-38495e83-5166-4d9b-8f9a-de3a93b80261 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:20.837026 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-38495e83-5166-4d9b-8f9a-de3a93b80261 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:20.837826 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-38495e83-5166-4d9b-8f9a-de3a93b80261 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:20.838264 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-38495e83-5166-4d9b-8f9a-de3a93b80261 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:20.962777 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-38495e83-5166-4d9b-8f9a-de3a93b80261 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:20.970017 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-38495e83-5166-4d9b-8f9a-de3a93b80261 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1507 microversion: 2.1 time: 0.144067 May 10 14:05:20.970585 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 388/751] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:20 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1507 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:21.184226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6ae44b91-ae71-4e38-9c12-a741270d4c7a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:21.184677 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-6ae44b91-ae71-4e38-9c12-a741270d4c7a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:21.190614 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ae44b91-ae71-4e38-9c12-a741270d4c7a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:21.191055 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ae44b91-ae71-4e38-9c12-a741270d4c7a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:21.191812 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ae44b91-ae71-4e38-9c12-a741270d4c7a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:21.192268 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6ae44b91-ae71-4e38-9c12-a741270d4c7a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:21.215167 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-6ae44b91-ae71-4e38-9c12-a741270d4c7a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lazy-loading 'flavor' on Instance uuid 18e6e847-c76f-441e-a7f8-63251b198a2d {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:05:21.464961 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6ae44b91-ae71-4e38-9c12-a741270d4c7a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "POST /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/action" status: 202 len: 0 microversion: 2.20 time: 0.284481 May 10 14:05:21.465583 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 364/752] 10.222.0.49 () {62 vars in 1318 bytes} [Tue May 10 14:05:21 2022] POST /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 14:05:21.473575 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3d4e3ea9-0830-4994-9544-f28eb0fa6d9e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:21.474178 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3d4e3ea9-0830-4994-9544-f28eb0fa6d9e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:21.480604 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d4e3ea9-0830-4994-9544-f28eb0fa6d9e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:21.481047 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d4e3ea9-0830-4994-9544-f28eb0fa6d9e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:21.481802 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d4e3ea9-0830-4994-9544-f28eb0fa6d9e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:21.482231 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d4e3ea9-0830-4994-9544-f28eb0fa6d9e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:21.539730 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ba2050dd-8df7-498e-b370-faf353fba992 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:21.540596 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ba2050dd-8df7-498e-b370-faf353fba992 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:21.547339 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ba2050dd-8df7-498e-b370-faf353fba992 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:21.547865 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ba2050dd-8df7-498e-b370-faf353fba992 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:21.548664 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ba2050dd-8df7-498e-b370-faf353fba992 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:21.549105 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ba2050dd-8df7-498e-b370-faf353fba992 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:21.615056 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3d4e3ea9-0830-4994-9544-f28eb0fa6d9e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:21.622862 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3d4e3ea9-0830-4994-9544-f28eb0fa6d9e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:21.624388 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3d4e3ea9-0830-4994-9544-f28eb0fa6d9e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:21.625538 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3d4e3ea9-0830-4994-9544-f28eb0fa6d9e tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.155785 May 10 14:05:21.626104 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 389/753] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:21 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:05:21.680336 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ba2050dd-8df7-498e-b370-faf353fba992 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:21.687624 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ba2050dd-8df7-498e-b370-faf353fba992 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1264 microversion: 2.1 time: 0.152622 May 10 14:05:21.688207 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 365/754] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:21 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:21.702676 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c2d9e0bf-16e5-43b1-8509-c6f5754ee2ec tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:21.703242 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c2d9e0bf-16e5-43b1-8509-c6f5754ee2ec tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:21.709041 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c2d9e0bf-16e5-43b1-8509-c6f5754ee2ec tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:21.709487 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c2d9e0bf-16e5-43b1-8509-c6f5754ee2ec tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:21.710245 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c2d9e0bf-16e5-43b1-8509-c6f5754ee2ec tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:21.710677 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c2d9e0bf-16e5-43b1-8509-c6f5754ee2ec tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:21.848550 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c2d9e0bf-16e5-43b1-8509-c6f5754ee2ec tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:21.855840 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c2d9e0bf-16e5-43b1-8509-c6f5754ee2ec tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1367 microversion: 2.1 time: 0.156964 May 10 14:05:21.856489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 390/755] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:21 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:21.987007 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-42f22f10-a53f-408b-8e67-5de7b8da6231 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:21.987528 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-42f22f10-a53f-408b-8e67-5de7b8da6231 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:21.993500 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-42f22f10-a53f-408b-8e67-5de7b8da6231 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:21.993948 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-42f22f10-a53f-408b-8e67-5de7b8da6231 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:21.994718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-42f22f10-a53f-408b-8e67-5de7b8da6231 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:21.995156 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-42f22f10-a53f-408b-8e67-5de7b8da6231 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:22.182895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-42f22f10-a53f-408b-8e67-5de7b8da6231 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:22.190064 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-42f22f10-a53f-408b-8e67-5de7b8da6231 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1507 microversion: 2.1 time: 0.207057 May 10 14:05:22.190630 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 366/756] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:21 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:22.595669 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-e3bcd1fd-3dc3-42f3-bece-79cd7eb17796 req-1acacff8-7377-4bff-b14d-2655c26ef6da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3b777f-9d47-4753-8fc8-27e7fabae486", "tag": "471a17c9-6251-41d8-9d93-8ecd7da310ca"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:22.608054 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-e3bcd1fd-3dc3-42f3-bece-79cd7eb17796 req-1acacff8-7377-4bff-b14d-2655c26ef6da service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:22.611083 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-e3bcd1fd-3dc3-42f3-bece-79cd7eb17796 req-1acacff8-7377-4bff-b14d-2655c26ef6da service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:22.622759 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-e3bcd1fd-3dc3-42f3-bece-79cd7eb17796 req-1acacff8-7377-4bff-b14d-2655c26ef6da service nova] Creating event network-changed:471a17c9-6251-41d8-9d93-8ecd7da310ca for instance ad3b777f-9d47-4753-8fc8-27e7fabae486 on hv-cinder-84067 May 10 14:05:22.628210 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-e3bcd1fd-3dc3-42f3-bece-79cd7eb17796 req-1acacff8-7377-4bff-b14d-2655c26ef6da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122327 May 10 14:05:22.630009 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 391/757] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:22.643329 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c4ae0749-cc15-400d-9c13-b8c7a20dc41b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:22.644948 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c4ae0749-cc15-400d-9c13-b8c7a20dc41b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:22.651699 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c4ae0749-cc15-400d-9c13-b8c7a20dc41b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:22.652341 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c4ae0749-cc15-400d-9c13-b8c7a20dc41b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:22.653212 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c4ae0749-cc15-400d-9c13-b8c7a20dc41b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:22.653751 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c4ae0749-cc15-400d-9c13-b8c7a20dc41b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:22.704784 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-aa696a56-90fd-4126-aeb9-8d7c34eb9005 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:22.705896 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-aa696a56-90fd-4126-aeb9-8d7c34eb9005 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:22.716517 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-aa696a56-90fd-4126-aeb9-8d7c34eb9005 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:22.717182 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-aa696a56-90fd-4126-aeb9-8d7c34eb9005 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:22.717979 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-aa696a56-90fd-4126-aeb9-8d7c34eb9005 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:22.718420 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-aa696a56-90fd-4126-aeb9-8d7c34eb9005 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:22.794352 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c4ae0749-cc15-400d-9c13-b8c7a20dc41b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:22.807928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c4ae0749-cc15-400d-9c13-b8c7a20dc41b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:22.807928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c4ae0749-cc15-400d-9c13-b8c7a20dc41b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:22.807928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c4ae0749-cc15-400d-9c13-b8c7a20dc41b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.169675 May 10 14:05:22.810514 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 367/758] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:22 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:22.855417 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-aa696a56-90fd-4126-aeb9-8d7c34eb9005 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:22.863266 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-aa696a56-90fd-4126-aeb9-8d7c34eb9005 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1264 microversion: 2.1 time: 0.162210 May 10 14:05:22.863847 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 392/759] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:22 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:22.873020 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d5eb082b-79e7-4dc8-b930-9df62aedee86 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:22.873632 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d5eb082b-79e7-4dc8-b930-9df62aedee86 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:22.880115 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d5eb082b-79e7-4dc8-b930-9df62aedee86 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:22.880594 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d5eb082b-79e7-4dc8-b930-9df62aedee86 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:22.881363 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d5eb082b-79e7-4dc8-b930-9df62aedee86 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:22.881805 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d5eb082b-79e7-4dc8-b930-9df62aedee86 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:23.004878 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d5eb082b-79e7-4dc8-b930-9df62aedee86 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:23.012082 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d5eb082b-79e7-4dc8-b930-9df62aedee86 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1367 microversion: 2.1 time: 0.142856 May 10 14:05:23.012697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 368/760] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:22 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1367 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:23.206779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0a9cac8e-aee6-4a40-a5ea-b6df5183a8b7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:23.207387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0a9cac8e-aee6-4a40-a5ea-b6df5183a8b7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:23.213320 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0a9cac8e-aee6-4a40-a5ea-b6df5183a8b7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:23.213772 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0a9cac8e-aee6-4a40-a5ea-b6df5183a8b7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:23.214531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0a9cac8e-aee6-4a40-a5ea-b6df5183a8b7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:23.214965 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0a9cac8e-aee6-4a40-a5ea-b6df5183a8b7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:23.607650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0a9cac8e-aee6-4a40-a5ea-b6df5183a8b7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:23.615374 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0a9cac8e-aee6-4a40-a5ea-b6df5183a8b7 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1507 microversion: 2.1 time: 0.412393 May 10 14:05:23.616327 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 393/761] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:23 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:23.828419 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-47bda8e6-7031-43b1-9a64-9fe0d47ba81a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:23.829641 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-47bda8e6-7031-43b1-9a64-9fe0d47ba81a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:23.838799 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-47bda8e6-7031-43b1-9a64-9fe0d47ba81a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:23.839319 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-47bda8e6-7031-43b1-9a64-9fe0d47ba81a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:23.840155 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-47bda8e6-7031-43b1-9a64-9fe0d47ba81a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:23.840616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-47bda8e6-7031-43b1-9a64-9fe0d47ba81a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:23.895918 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-83b23a14-8b15-4aa7-8123-70c258aeff57 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:23.896571 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-83b23a14-8b15-4aa7-8123-70c258aeff57 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:23.902638 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-83b23a14-8b15-4aa7-8123-70c258aeff57 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:23.903096 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-83b23a14-8b15-4aa7-8123-70c258aeff57 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:23.903875 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-83b23a14-8b15-4aa7-8123-70c258aeff57 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:23.904416 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-83b23a14-8b15-4aa7-8123-70c258aeff57 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:24.006101 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-47bda8e6-7031-43b1-9a64-9fe0d47ba81a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:24.014709 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-47bda8e6-7031-43b1-9a64-9fe0d47ba81a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:24.016549 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-47bda8e6-7031-43b1-9a64-9fe0d47ba81a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:24.018017 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-47bda8e6-7031-43b1-9a64-9fe0d47ba81a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.193892 May 10 14:05:24.029642 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 369/762] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:23 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:24.033219 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-44e31409-80ae-4f0e-9969-cca9c279d90e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:24.033827 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-44e31409-80ae-4f0e-9969-cca9c279d90e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:24.039639 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-44e31409-80ae-4f0e-9969-cca9c279d90e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:24.040091 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-44e31409-80ae-4f0e-9969-cca9c279d90e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:24.040901 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-44e31409-80ae-4f0e-9969-cca9c279d90e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:24.041011 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-83b23a14-8b15-4aa7-8123-70c258aeff57 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:24.041333 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-44e31409-80ae-4f0e-9969-cca9c279d90e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:24.048348 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-83b23a14-8b15-4aa7-8123-70c258aeff57 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1264 microversion: 2.1 time: 0.170674 May 10 14:05:24.048915 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 394/763] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:23 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:24.167909 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-44e31409-80ae-4f0e-9969-cca9c279d90e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:24.175057 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-44e31409-80ae-4f0e-9969-cca9c279d90e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1367 microversion: 2.1 time: 0.145630 May 10 14:05:24.176125 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 370/764] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:24 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:24.632161 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-899bcb9a-35b8-4294-b2ea-33918e086a0e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:24.632909 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-899bcb9a-35b8-4294-b2ea-33918e086a0e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:24.639681 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-899bcb9a-35b8-4294-b2ea-33918e086a0e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:24.640309 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-899bcb9a-35b8-4294-b2ea-33918e086a0e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:24.641198 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-899bcb9a-35b8-4294-b2ea-33918e086a0e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:24.641742 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-899bcb9a-35b8-4294-b2ea-33918e086a0e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:24.643049 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-5935a4f3-3f9b-4ee1-aa7c-ff2580f9f456 req-94e36910-1226-4f5c-a91b-4ea66e5e5c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99093de-3e49-4cee-b398-90c326ef8050", "name": "network-vif-deleted", "tag": "0f558f56-6f77-4669-b4bd-6cfd29789243"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:24.651223 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-5935a4f3-3f9b-4ee1-aa7c-ff2580f9f456 req-94e36910-1226-4f5c-a91b-4ea66e5e5c5a service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:24.651657 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-5935a4f3-3f9b-4ee1-aa7c-ff2580f9f456 req-94e36910-1226-4f5c-a91b-4ea66e5e5c5a service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:24.663902 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-5935a4f3-3f9b-4ee1-aa7c-ff2580f9f456 req-94e36910-1226-4f5c-a91b-4ea66e5e5c5a service nova] Creating event network-vif-deleted:0f558f56-6f77-4669-b4bd-6cfd29789243 for instance c99093de-3e49-4cee-b398-90c326ef8050 on hv-cinder-84067 May 10 14:05:24.668513 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-5935a4f3-3f9b-4ee1-aa7c-ff2580f9f456 req-94e36910-1226-4f5c-a91b-4ea66e5e5c5a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028977 May 10 14:05:24.669303 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 371/765] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:05:24.706356 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-899bcb9a-35b8-4294-b2ea-33918e086a0e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:24.714860 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-899bcb9a-35b8-4294-b2ea-33918e086a0e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 200 len: 1465 microversion: 2.1 time: 0.086492 May 10 14:05:24.725792 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 395/766] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:24 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 1465 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:25.038872 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5d27e8f0-3deb-42c0-8f1c-cd9a57bd434c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:25.039573 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-5d27e8f0-3deb-42c0-8f1c-cd9a57bd434c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:25.045629 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5d27e8f0-3deb-42c0-8f1c-cd9a57bd434c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.046088 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5d27e8f0-3deb-42c0-8f1c-cd9a57bd434c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.046858 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5d27e8f0-3deb-42c0-8f1c-cd9a57bd434c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.047299 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5d27e8f0-3deb-42c0-8f1c-cd9a57bd434c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.065328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3497afa8-af26-4bb4-b002-de301cdfddf7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:25.065958 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3497afa8-af26-4bb4-b002-de301cdfddf7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:25.071711 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3497afa8-af26-4bb4-b002-de301cdfddf7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.072159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3497afa8-af26-4bb4-b002-de301cdfddf7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.073068 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3497afa8-af26-4bb4-b002-de301cdfddf7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.073509 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3497afa8-af26-4bb4-b002-de301cdfddf7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.190397 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-5d27e8f0-3deb-42c0-8f1c-cd9a57bd434c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:25.204576 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-5d27e8f0-3deb-42c0-8f1c-cd9a57bd434c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:25.207271 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-5d27e8f0-3deb-42c0-8f1c-cd9a57bd434c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:25.208855 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-5d27e8f0-3deb-42c0-8f1c-cd9a57bd434c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.175339 May 10 14:05:25.210509 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 372/767] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:25 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:05:25.216595 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-eb5831fe-f53a-44a7-bcb3-7fab8f5396bb tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:25.218241 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-eb5831fe-f53a-44a7-bcb3-7fab8f5396bb tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:25.218910 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3497afa8-af26-4bb4-b002-de301cdfddf7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:25.226918 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3497afa8-af26-4bb4-b002-de301cdfddf7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1264 microversion: 2.1 time: 0.165734 May 10 14:05:25.227390 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-eb5831fe-f53a-44a7-bcb3-7fab8f5396bb tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.227844 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-eb5831fe-f53a-44a7-bcb3-7fab8f5396bb tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.228853 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-eb5831fe-f53a-44a7-bcb3-7fab8f5396bb tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.229280 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-eb5831fe-f53a-44a7-bcb3-7fab8f5396bb tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.232092 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 396/768] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:25 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:25.668645 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-eb5831fe-f53a-44a7-bcb3-7fab8f5396bb tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:25.676442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-eb5831fe-f53a-44a7-bcb3-7fab8f5396bb tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1367 microversion: 2.1 time: 0.464701 May 10 14:05:25.677004 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 373/769] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:25 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1367 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:25.733069 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0010442e-df89-4e89-a31b-c934d70855c4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:25.733717 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0010442e-df89-4e89-a31b-c934d70855c4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: c99093de-3e49-4cee-b398-90c326ef8050] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:25.740075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0010442e-df89-4e89-a31b-c934d70855c4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.740578 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0010442e-df89-4e89-a31b-c934d70855c4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.741358 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0010442e-df89-4e89-a31b-c934d70855c4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.741802 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0010442e-df89-4e89-a31b-c934d70855c4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.754994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-0010442e-df89-4e89-a31b-c934d70855c4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] HTTP exception thrown: Instance c99093de-3e49-4cee-b398-90c326ef8050 could not be found. May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0010442e-df89-4e89-a31b-c934d70855c4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Request method failure captured: May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 HTTP/1.1 May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_xDu6JK8pwUvXha8KU8vHpKnPJ5AHhm1By_XEE5j72JnoFzaYxegH6ZsuxN4FWA1raNtM_ROxaWfY0nbamU8BT7VWF1Y7WMNmjHep8IOoIxRuQKI3XGxdDGrNRZkarxHVxP2Sbt7uY3g2tkENQuSC7H9HTviVk1BNO3aP-ni1o7Qs May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 368287ad726146f88559c73a86e4b26d May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:05:25.756779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:05:25.758398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/368287ad726146f88559c73a86e4b26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_368287ad726146f88559c73a86e4b26d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/368287ad726146f88559c73a86e4b26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/368287ad726146f88559c73a86e4b26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:05:25.758398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:05:25.758398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 368287ad726146f88559c73a86e4b26d May 10 14:05:25.758398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:05:25.758398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-ServerRescueNegativeTestJSON-1855127385-project May 10 14:05:25.758398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:05:25.758398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:05:25.758398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: bd14de0fd51c4fd89d9875b9c47100cc May 10 14:05:25.758398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855127385-project May 10 14:05:25.758398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:05:25.758398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance c99093de-3e49-4cee-b398-90c326ef8050 could not be found. May 10 14:05:25.758398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': 'c99093de-3e49-4cee-b398-90c326ef8050'} May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99093de-3e49-4cee-b398-90c326ef8050 could not be found. May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:05:25.759214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99093de-3e49-4cee-b398-90c326ef8050 could not be found. May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99093de-3e49-4cee-b398-90c326ef8050 could not be found. May 10 14:05:25.760535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:25.762325 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0010442e-df89-4e89-a31b-c934d70855c4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Returning 404 to user: Instance c99093de-3e49-4cee-b398-90c326ef8050 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:05:25.762325 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0010442e-df89-4e89-a31b-c934d70855c4 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050" status: 404 len: 111 microversion: 2.1 time: 0.028983 May 10 14:05:25.762325 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 397/770] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:25 2022] GET /compute/v2.1/servers/c99093de-3e49-4cee-b398-90c326ef8050 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:05:25.766715 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1b0b384a-1067-4667-9264-c4d074c5e90d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:25.767237 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1b0b384a-1067-4667-9264-c4d074c5e90d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:25.773902 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1b0b384a-1067-4667-9264-c4d074c5e90d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.774349 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1b0b384a-1067-4667-9264-c4d074c5e90d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.775120 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1b0b384a-1067-4667-9264-c4d074c5e90d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.775556 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1b0b384a-1067-4667-9264-c4d074c5e90d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.803545 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1b0b384a-1067-4667-9264-c4d074c5e90d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Going to try to terminate instance {{(pid=117153) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:05:25.881439 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1b0b384a-1067-4667-9264-c4d074c5e90d tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "DELETE /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 204 len: 0 microversion: 2.1 time: 0.118325 May 10 14:05:25.882727 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 374/771] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:05:25 2022] DELETE /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:05:25.890814 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e2d24597-e892-4e89-81cb-b4d50dc3a27e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:25.891432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e2d24597-e892-4e89-81cb-b4d50dc3a27e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:25.898368 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e2d24597-e892-4e89-81cb-b4d50dc3a27e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.898830 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e2d24597-e892-4e89-81cb-b4d50dc3a27e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.899608 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e2d24597-e892-4e89-81cb-b4d50dc3a27e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.900055 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e2d24597-e892-4e89-81cb-b4d50dc3a27e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:26.025971 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e2d24597-e892-4e89-81cb-b4d50dc3a27e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:26.033206 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e2d24597-e892-4e89-81cb-b4d50dc3a27e tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.146204 May 10 14:05:26.033762 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 398/772] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:25 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:26.228531 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8e9b0d6a-19c5-418e-95f3-dc697e87be15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:26.229149 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8e9b0d6a-19c5-418e-95f3-dc697e87be15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:26.235370 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8e9b0d6a-19c5-418e-95f3-dc697e87be15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:26.235820 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8e9b0d6a-19c5-418e-95f3-dc697e87be15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:26.236617 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8e9b0d6a-19c5-418e-95f3-dc697e87be15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:26.237054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8e9b0d6a-19c5-418e-95f3-dc697e87be15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:26.249047 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-b4e7ce5b-d496-421e-bdba-de3cb30770fb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:26.249676 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-b4e7ce5b-d496-421e-bdba-de3cb30770fb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:26.255954 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b4e7ce5b-d496-421e-bdba-de3cb30770fb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:26.256441 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b4e7ce5b-d496-421e-bdba-de3cb30770fb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:26.257208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b4e7ce5b-d496-421e-bdba-de3cb30770fb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:26.257641 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b4e7ce5b-d496-421e-bdba-de3cb30770fb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:26.369526 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8e9b0d6a-19c5-418e-95f3-dc697e87be15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:26.377360 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8e9b0d6a-19c5-418e-95f3-dc697e87be15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:26.379377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8e9b0d6a-19c5-418e-95f3-dc697e87be15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:26.380599 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8e9b0d6a-19c5-418e-95f3-dc697e87be15 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.156478 May 10 14:05:26.381165 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 375/773] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:26 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:26.390068 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-b4e7ce5b-d496-421e-bdba-de3cb30770fb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:26.397769 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-b4e7ce5b-d496-421e-bdba-de3cb30770fb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1264 microversion: 2.1 time: 0.152564 May 10 14:05:26.398328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 399/774] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:26 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:26.694799 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e824e576-575a-4706-930b-71a63a81dda4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:26.695414 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e824e576-575a-4706-930b-71a63a81dda4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:26.701257 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e824e576-575a-4706-930b-71a63a81dda4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:26.701705 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e824e576-575a-4706-930b-71a63a81dda4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:26.702476 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e824e576-575a-4706-930b-71a63a81dda4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:26.702913 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e824e576-575a-4706-930b-71a63a81dda4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:26.829728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e824e576-575a-4706-930b-71a63a81dda4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:26.837595 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e824e576-575a-4706-930b-71a63a81dda4 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1367 microversion: 2.1 time: 0.147961 May 10 14:05:26.838280 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 376/775] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:26 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:26.891500 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-f4fa1a86-591c-4852-ade8-f8be9f2cf00e req-edd806f7-c891-456b-9b08-76880c83c685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821e2fc1-0f9b-40f0-a08e-cb87df184140", "name": "network-vif-plugged", "status": "completed", "tag": "1b71aba5-cc9f-45c9-8184-f38605a005e7"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:26.900483 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-f4fa1a86-591c-4852-ade8-f8be9f2cf00e req-edd806f7-c891-456b-9b08-76880c83c685 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:26.900928 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-f4fa1a86-591c-4852-ade8-f8be9f2cf00e req-edd806f7-c891-456b-9b08-76880c83c685 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:26.912392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-f4fa1a86-591c-4852-ade8-f8be9f2cf00e req-edd806f7-c891-456b-9b08-76880c83c685 service nova] Creating event network-vif-plugged:1b71aba5-cc9f-45c9-8184-f38605a005e7 for instance 821e2fc1-0f9b-40f0-a08e-cb87df184140 on hv-cinder-84067 May 10 14:05:26.919614 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-f4fa1a86-591c-4852-ade8-f8be9f2cf00e req-edd806f7-c891-456b-9b08-76880c83c685 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031304 May 10 14:05:26.920574 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 400/776] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:05:27.050658 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9e18fcbd-bd56-4ecb-bc55-67861d007644 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:27.051260 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9e18fcbd-bd56-4ecb-bc55-67861d007644 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:27.057219 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e18fcbd-bd56-4ecb-bc55-67861d007644 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:27.057662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e18fcbd-bd56-4ecb-bc55-67861d007644 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:27.058423 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e18fcbd-bd56-4ecb-bc55-67861d007644 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:27.058856 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e18fcbd-bd56-4ecb-bc55-67861d007644 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:27.185050 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9e18fcbd-bd56-4ecb-bc55-67861d007644 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:27.193047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9e18fcbd-bd56-4ecb-bc55-67861d007644 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.146189 May 10 14:05:27.193646 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 377/777] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:27 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:27.399894 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-24083aae-7200-44b8-838c-a6eaa413fb12 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:27.400634 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-24083aae-7200-44b8-838c-a6eaa413fb12 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:27.406653 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-24083aae-7200-44b8-838c-a6eaa413fb12 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:27.407097 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-24083aae-7200-44b8-838c-a6eaa413fb12 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:27.407853 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-24083aae-7200-44b8-838c-a6eaa413fb12 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:27.408323 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-24083aae-7200-44b8-838c-a6eaa413fb12 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:27.414846 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-87879a06-c2a7-46df-b20e-e84bcdb89c1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:27.415464 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-87879a06-c2a7-46df-b20e-e84bcdb89c1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:27.421926 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-87879a06-c2a7-46df-b20e-e84bcdb89c1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:27.422382 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-87879a06-c2a7-46df-b20e-e84bcdb89c1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:27.423164 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-87879a06-c2a7-46df-b20e-e84bcdb89c1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:27.423603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-87879a06-c2a7-46df-b20e-e84bcdb89c1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:27.538826 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-24083aae-7200-44b8-838c-a6eaa413fb12 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:27.546597 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-24083aae-7200-44b8-838c-a6eaa413fb12 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:27.548104 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-24083aae-7200-44b8-838c-a6eaa413fb12 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:27.549296 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-24083aae-7200-44b8-838c-a6eaa413fb12 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.153596 May 10 14:05:27.549860 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 401/778] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:27 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:27.557177 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-87879a06-c2a7-46df-b20e-e84bcdb89c1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:27.564508 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-87879a06-c2a7-46df-b20e-e84bcdb89c1f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1264 microversion: 2.1 time: 0.153491 May 10 14:05:27.565101 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 378/779] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:27 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:27.854333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bc5b35fc-c129-4c9e-81d7-c3bf1463e3fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:27.854875 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-bc5b35fc-c129-4c9e-81d7-c3bf1463e3fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:27.860970 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bc5b35fc-c129-4c9e-81d7-c3bf1463e3fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:27.861424 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bc5b35fc-c129-4c9e-81d7-c3bf1463e3fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:27.862195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bc5b35fc-c129-4c9e-81d7-c3bf1463e3fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:27.862635 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bc5b35fc-c129-4c9e-81d7-c3bf1463e3fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:27.986562 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-bc5b35fc-c129-4c9e-81d7-c3bf1463e3fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:27.994376 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-bc5b35fc-c129-4c9e-81d7-c3bf1463e3fa tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1367 microversion: 2.1 time: 0.144000 May 10 14:05:27.994948 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 402/780] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:27 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:28.210443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2811c9c1-f194-4b03-b167-f9b6be6f18dc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:28.211047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2811c9c1-f194-4b03-b167-f9b6be6f18dc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:28.216996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2811c9c1-f194-4b03-b167-f9b6be6f18dc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:28.217421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2811c9c1-f194-4b03-b167-f9b6be6f18dc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:28.218182 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2811c9c1-f194-4b03-b167-f9b6be6f18dc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:28.218618 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2811c9c1-f194-4b03-b167-f9b6be6f18dc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:28.353381 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2811c9c1-f194-4b03-b167-f9b6be6f18dc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:28.360584 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2811c9c1-f194-4b03-b167-f9b6be6f18dc tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.154501 May 10 14:05:28.361155 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 379/781] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:28 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:28.566877 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bd427a46-fbdc-40c3-941d-f49cf4bb7b90 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:28.567420 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-bd427a46-fbdc-40c3-941d-f49cf4bb7b90 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:28.573388 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bd427a46-fbdc-40c3-941d-f49cf4bb7b90 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:28.573839 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bd427a46-fbdc-40c3-941d-f49cf4bb7b90 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:28.574610 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bd427a46-fbdc-40c3-941d-f49cf4bb7b90 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:28.576111 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bd427a46-fbdc-40c3-941d-f49cf4bb7b90 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:28.581797 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e7497672-b7c6-4887-acee-db287e9d041b tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:28.582400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e7497672-b7c6-4887-acee-db287e9d041b tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:28.599526 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e7497672-b7c6-4887-acee-db287e9d041b tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:28.602132 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e7497672-b7c6-4887-acee-db287e9d041b tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:28.603186 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e7497672-b7c6-4887-acee-db287e9d041b tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:28.603761 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e7497672-b7c6-4887-acee-db287e9d041b tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:28.724322 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-bd427a46-fbdc-40c3-941d-f49cf4bb7b90 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:28.733516 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-bd427a46-fbdc-40c3-941d-f49cf4bb7b90 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:28.735029 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-bd427a46-fbdc-40c3-941d-f49cf4bb7b90 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:28.736229 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-bd427a46-fbdc-40c3-941d-f49cf4bb7b90 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.173332 May 10 14:05:28.748026 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 403/782] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:28 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:28.752214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e7497672-b7c6-4887-acee-db287e9d041b tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:28.759755 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e7497672-b7c6-4887-acee-db287e9d041b tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1264 microversion: 2.1 time: 0.182391 May 10 14:05:28.760392 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 380/783] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:28 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:28.945027 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-d386c87d-9c92-48f4-a5a6-6eab6ea378f8 req-287f555f-030f-4005-b73f-d6df1da7c04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3b777f-9d47-4753-8fc8-27e7fabae486", "name": "network-vif-plugged", "status": "completed", "tag": "471a17c9-6251-41d8-9d93-8ecd7da310ca"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:28.953491 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-d386c87d-9c92-48f4-a5a6-6eab6ea378f8 req-287f555f-030f-4005-b73f-d6df1da7c04e service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:28.953938 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-d386c87d-9c92-48f4-a5a6-6eab6ea378f8 req-287f555f-030f-4005-b73f-d6df1da7c04e service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:28.965263 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-d386c87d-9c92-48f4-a5a6-6eab6ea378f8 req-287f555f-030f-4005-b73f-d6df1da7c04e service nova] Creating event network-vif-plugged:471a17c9-6251-41d8-9d93-8ecd7da310ca for instance ad3b777f-9d47-4753-8fc8-27e7fabae486 on hv-cinder-84067 May 10 14:05:28.969964 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-d386c87d-9c92-48f4-a5a6-6eab6ea378f8 req-287f555f-030f-4005-b73f-d6df1da7c04e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028693 May 10 14:05:28.970565 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 404/784] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:29.010684 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b6caf4ab-3e1a-4266-89b2-d32254580f14 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:29.011347 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b6caf4ab-3e1a-4266-89b2-d32254580f14 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:29.017428 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6caf4ab-3e1a-4266-89b2-d32254580f14 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:29.017882 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6caf4ab-3e1a-4266-89b2-d32254580f14 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:29.019450 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6caf4ab-3e1a-4266-89b2-d32254580f14 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:29.019991 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6caf4ab-3e1a-4266-89b2-d32254580f14 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:29.145924 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b6caf4ab-3e1a-4266-89b2-d32254580f14 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:29.153488 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b6caf4ab-3e1a-4266-89b2-d32254580f14 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1367 microversion: 2.1 time: 0.146618 May 10 14:05:29.154410 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 381/785] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:29 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:29.379094 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0d77c37f-31fc-4952-8209-8c8080ae7cb1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:29.380555 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0d77c37f-31fc-4952-8209-8c8080ae7cb1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:29.390338 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0d77c37f-31fc-4952-8209-8c8080ae7cb1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:29.391131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0d77c37f-31fc-4952-8209-8c8080ae7cb1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:29.392132 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0d77c37f-31fc-4952-8209-8c8080ae7cb1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:29.392806 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0d77c37f-31fc-4952-8209-8c8080ae7cb1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:29.579096 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0d77c37f-31fc-4952-8209-8c8080ae7cb1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:29.586472 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0d77c37f-31fc-4952-8209-8c8080ae7cb1 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1522 microversion: 2.1 time: 0.212449 May 10 14:05:29.587079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 405/786] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:29 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:29.758500 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c73f3ad8-fb49-40f5-84be-90dbcdd758aa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:29.759118 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c73f3ad8-fb49-40f5-84be-90dbcdd758aa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:29.774744 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c73f3ad8-fb49-40f5-84be-90dbcdd758aa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:29.775323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c73f3ad8-fb49-40f5-84be-90dbcdd758aa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:29.776393 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c73f3ad8-fb49-40f5-84be-90dbcdd758aa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:29.777074 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c73f3ad8-fb49-40f5-84be-90dbcdd758aa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:29.777696 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e3a7bd4e-b141-4432-aed7-1d2c124df868 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:29.778316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e3a7bd4e-b141-4432-aed7-1d2c124df868 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:29.784964 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e3a7bd4e-b141-4432-aed7-1d2c124df868 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:29.785741 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e3a7bd4e-b141-4432-aed7-1d2c124df868 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:29.786727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e3a7bd4e-b141-4432-aed7-1d2c124df868 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:29.787360 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e3a7bd4e-b141-4432-aed7-1d2c124df868 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:29.914356 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c73f3ad8-fb49-40f5-84be-90dbcdd758aa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:29.919141 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e3a7bd4e-b141-4432-aed7-1d2c124df868 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:29.922623 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c73f3ad8-fb49-40f5-84be-90dbcdd758aa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:29.924130 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c73f3ad8-fb49-40f5-84be-90dbcdd758aa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:29.925905 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c73f3ad8-fb49-40f5-84be-90dbcdd758aa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.174366 May 10 14:05:29.926692 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 382/787] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:29 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:29.927930 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e3a7bd4e-b141-4432-aed7-1d2c124df868 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1264 microversion: 2.1 time: 0.154008 May 10 14:05:29.928556 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 406/788] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:29 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:29.931704 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-415a4cfb-1b84-49f8-92eb-f9022a3e1b2b req-a8f7599e-2bc1-4e73-893a-5c317b11d4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54be9a2c-c327-4249-ba65-0fc49162bac7", "name": "network-vif-deleted", "tag": "54c8afe4-b86d-4757-bf04-f87c35143a83"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:29.939732 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-415a4cfb-1b84-49f8-92eb-f9022a3e1b2b req-a8f7599e-2bc1-4e73-893a-5c317b11d4ec service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:29.940185 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-415a4cfb-1b84-49f8-92eb-f9022a3e1b2b req-a8f7599e-2bc1-4e73-893a-5c317b11d4ec service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:29.950533 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-415a4cfb-1b84-49f8-92eb-f9022a3e1b2b req-a8f7599e-2bc1-4e73-893a-5c317b11d4ec service nova] Creating event network-vif-deleted:54c8afe4-b86d-4757-bf04-f87c35143a83 for instance 54be9a2c-c327-4249-ba65-0fc49162bac7 on hv-cinder-84067 May 10 14:05:29.955240 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-415a4cfb-1b84-49f8-92eb-f9022a3e1b2b req-a8f7599e-2bc1-4e73-893a-5c317b11d4ec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027311 May 10 14:05:29.955790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 383/789] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:30.170846 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5779a254-c9e0-4f79-8d8a-5847454e717e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:30.171457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5779a254-c9e0-4f79-8d8a-5847454e717e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:30.178806 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5779a254-c9e0-4f79-8d8a-5847454e717e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:30.179253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5779a254-c9e0-4f79-8d8a-5847454e717e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:30.180264 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5779a254-c9e0-4f79-8d8a-5847454e717e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:30.180707 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5779a254-c9e0-4f79-8d8a-5847454e717e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:30.312673 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5779a254-c9e0-4f79-8d8a-5847454e717e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:30.320485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5779a254-c9e0-4f79-8d8a-5847454e717e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1367 microversion: 2.1 time: 0.153483 May 10 14:05:30.320989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 407/790] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:30 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:30.603784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-55fa105e-aa1d-474e-a537-052429cfb84b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:30.604416 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-55fa105e-aa1d-474e-a537-052429cfb84b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:30.610441 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-55fa105e-aa1d-474e-a537-052429cfb84b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:30.610882 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-55fa105e-aa1d-474e-a537-052429cfb84b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:30.611666 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-55fa105e-aa1d-474e-a537-052429cfb84b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:30.612094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-55fa105e-aa1d-474e-a537-052429cfb84b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:30.673344 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-55fa105e-aa1d-474e-a537-052429cfb84b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:30.681327 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-55fa105e-aa1d-474e-a537-052429cfb84b tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1307 microversion: 2.1 time: 0.081807 May 10 14:05:30.681898 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 384/791] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:30 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1307 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:30.944639 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-788c8a02-2601-4a18-8464-a689df39ff04 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:30.945287 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-788c8a02-2601-4a18-8464-a689df39ff04 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:30.945676 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0225d002-2055-43dd-bdc6-4a3d61cd23e0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:30.946286 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0225d002-2055-43dd-bdc6-4a3d61cd23e0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:30.951365 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-788c8a02-2601-4a18-8464-a689df39ff04 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:30.951858 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-788c8a02-2601-4a18-8464-a689df39ff04 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:30.952118 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0225d002-2055-43dd-bdc6-4a3d61cd23e0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:30.952674 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-788c8a02-2601-4a18-8464-a689df39ff04 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:30.952788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0225d002-2055-43dd-bdc6-4a3d61cd23e0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:30.953134 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-788c8a02-2601-4a18-8464-a689df39ff04 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:30.953463 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0225d002-2055-43dd-bdc6-4a3d61cd23e0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:30.953904 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0225d002-2055-43dd-bdc6-4a3d61cd23e0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:31.089355 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0225d002-2055-43dd-bdc6-4a3d61cd23e0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:31.095181 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-788c8a02-2601-4a18-8464-a689df39ff04 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:31.097038 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0225d002-2055-43dd-bdc6-4a3d61cd23e0 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1264 microversion: 2.1 time: 0.156389 May 10 14:05:31.098139 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 385/792] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:30 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:31.104421 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-788c8a02-2601-4a18-8464-a689df39ff04 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:31.106039 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-788c8a02-2601-4a18-8464-a689df39ff04 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:31.107326 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-788c8a02-2601-4a18-8464-a689df39ff04 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.167229 May 10 14:05:31.107907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 408/793] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:30 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:31.337185 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bf339e21-1769-405e-9fcd-a45198f1fea3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:31.337720 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bf339e21-1769-405e-9fcd-a45198f1fea3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:31.343599 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf339e21-1769-405e-9fcd-a45198f1fea3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:31.344045 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf339e21-1769-405e-9fcd-a45198f1fea3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:31.344847 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf339e21-1769-405e-9fcd-a45198f1fea3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:31.345282 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf339e21-1769-405e-9fcd-a45198f1fea3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:31.474147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bf339e21-1769-405e-9fcd-a45198f1fea3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:31.481366 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bf339e21-1769-405e-9fcd-a45198f1fea3 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1367 microversion: 2.1 time: 0.148072 May 10 14:05:31.481937 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 386/794] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:31 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:31.697959 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e42e218e-4394-44a6-b45a-488b28ab6deb tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:31.698590 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e42e218e-4394-44a6-b45a-488b28ab6deb tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:31.704992 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e42e218e-4394-44a6-b45a-488b28ab6deb tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:31.705469 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e42e218e-4394-44a6-b45a-488b28ab6deb tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:31.706859 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e42e218e-4394-44a6-b45a-488b28ab6deb tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:31.707332 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e42e218e-4394-44a6-b45a-488b28ab6deb tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:31.738398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e42e218e-4394-44a6-b45a-488b28ab6deb tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:31.738848 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e42e218e-4394-44a6-b45a-488b28ab6deb tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:31.739294 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-e42e218e-4394-44a6-b45a-488b28ab6deb tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lazy-loading 'fault' on Instance uuid 54be9a2c-c327-4249-ba65-0fc49162bac7 {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:05:31.779572 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e42e218e-4394-44a6-b45a-488b28ab6deb tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd14de0fd51c4fd89d9875b9c47100cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368287ad726146f88559c73a86e4b26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:31.787456 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e42e218e-4394-44a6-b45a-488b28ab6deb tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 200 len: 1312 microversion: 2.1 time: 0.093373 May 10 14:05:31.788015 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 409/795] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:31 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:32.114623 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-49291235-9023-46da-8d01-8733c82ce229 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:32.115233 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-49291235-9023-46da-8d01-8733c82ce229 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:32.121588 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-49291235-9023-46da-8d01-8733c82ce229 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.122041 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-49291235-9023-46da-8d01-8733c82ce229 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.122809 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-49291235-9023-46da-8d01-8733c82ce229 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.123244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-49291235-9023-46da-8d01-8733c82ce229 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.125715 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-80415830-fa58-4d36-9860-a1ea94e22002 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:32.126460 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-80415830-fa58-4d36-9860-a1ea94e22002 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:32.133050 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-80415830-fa58-4d36-9860-a1ea94e22002 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.133525 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-80415830-fa58-4d36-9860-a1ea94e22002 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.134303 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-80415830-fa58-4d36-9860-a1ea94e22002 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.134730 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-80415830-fa58-4d36-9860-a1ea94e22002 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.253738 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-49291235-9023-46da-8d01-8733c82ce229 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:32.261144 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-49291235-9023-46da-8d01-8733c82ce229 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1451 microversion: 2.1 time: 0.150363 May 10 14:05:32.261891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 387/796] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:32 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:32.264537 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-80415830-fa58-4d36-9860-a1ea94e22002 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:32.273355 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-80415830-fa58-4d36-9860-a1ea94e22002 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:32.274867 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-80415830-fa58-4d36-9860-a1ea94e22002 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:32.276027 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-80415830-fa58-4d36-9860-a1ea94e22002 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.154347 May 10 14:05:32.276621 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 410/797] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:32 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:05:32.277762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1a9ca6f3-c683-4676-b7d7-5f1416efff79 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:32.278394 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1a9ca6f3-c683-4676-b7d7-5f1416efff79 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:32.284145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1a9ca6f3-c683-4676-b7d7-5f1416efff79 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.284693 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1a9ca6f3-c683-4676-b7d7-5f1416efff79 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.285449 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1a9ca6f3-c683-4676-b7d7-5f1416efff79 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.285882 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1a9ca6f3-c683-4676-b7d7-5f1416efff79 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.413629 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1a9ca6f3-c683-4676-b7d7-5f1416efff79 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:32.421075 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1a9ca6f3-c683-4676-b7d7-5f1416efff79 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1451 microversion: 2.1 time: 0.147279 May 10 14:05:32.421642 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 388/798] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:32 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:32.499667 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f011d7a0-1683-4e4a-b8f5-3290de1de346 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:32.500322 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f011d7a0-1683-4e4a-b8f5-3290de1de346 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:32.507123 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f011d7a0-1683-4e4a-b8f5-3290de1de346 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.507589 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f011d7a0-1683-4e4a-b8f5-3290de1de346 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.508399 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f011d7a0-1683-4e4a-b8f5-3290de1de346 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.508879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f011d7a0-1683-4e4a-b8f5-3290de1de346 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.704323 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f011d7a0-1683-4e4a-b8f5-3290de1de346 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:32.713368 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f011d7a0-1683-4e4a-b8f5-3290de1de346 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1557 microversion: 2.1 time: 0.218265 May 10 14:05:32.714109 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 411/799] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:32 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:32.730405 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1898d92c-5888-45f8-bbae-1bc533c069bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:32.730908 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1898d92c-5888-45f8-bbae-1bc533c069bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:32.737015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1898d92c-5888-45f8-bbae-1bc533c069bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.737459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1898d92c-5888-45f8-bbae-1bc533c069bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.738769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1898d92c-5888-45f8-bbae-1bc533c069bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.739208 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1898d92c-5888-45f8-bbae-1bc533c069bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.806206 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-631cbc30-fc18-433d-8df2-fe05ac05be10 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:32.807053 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-631cbc30-fc18-433d-8df2-fe05ac05be10 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] [instance: 54be9a2c-c327-4249-ba65-0fc49162bac7] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:32.813386 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-631cbc30-fc18-433d-8df2-fe05ac05be10 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.813908 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-631cbc30-fc18-433d-8df2-fe05ac05be10 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.814759 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-631cbc30-fc18-433d-8df2-fe05ac05be10 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.815293 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-631cbc30-fc18-433d-8df2-fe05ac05be10 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.825423 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1898d92c-5888-45f8-bbae-1bc533c069bf tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098963 May 10 14:05:32.826286 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 389/800] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 14:05:32 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:32.829541 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-631cbc30-fc18-433d-8df2-fe05ac05be10 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] HTTP exception thrown: Instance 54be9a2c-c327-4249-ba65-0fc49162bac7 could not be found. May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-631cbc30-fc18-433d-8df2-fe05ac05be10 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Request method failure captured: May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 HTTP/1.1 May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_xDu6JK8pwUvXha8KU8vHpKnPJ5AHhm1By_XEE5j72JnoFzaYxegH6ZsuxN4FWA1raNtM_ROxaWfY0nbamU8BT7VWF1Y7WMNmjHep8IOoIxRuQKI3XGxdDGrNRZkarxHVxP2Sbt7uY3g2tkENQuSC7H9HTviVk1BNO3aP-ni1o7Qs May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 368287ad726146f88559c73a86e4b26d May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:05:32.831584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:05:32.833237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/368287ad726146f88559c73a86e4b26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_368287ad726146f88559c73a86e4b26d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/368287ad726146f88559c73a86e4b26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/368287ad726146f88559c73a86e4b26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:05:32.833237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:05:32.833237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 368287ad726146f88559c73a86e4b26d May 10 14:05:32.833237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855127385 May 10 14:05:32.833237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-ServerRescueNegativeTestJSON-1855127385-project May 10 14:05:32.833237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:05:32.833237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:05:32.833237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: bd14de0fd51c4fd89d9875b9c47100cc May 10 14:05:32.833237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855127385-project May 10 14:05:32.833237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:05:32.833237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 54be9a2c-c327-4249-ba65-0fc49162bac7 could not be found. May 10 14:05:32.833237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '54be9a2c-c327-4249-ba65-0fc49162bac7'} May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54be9a2c-c327-4249-ba65-0fc49162bac7 could not be found. May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:05:32.834140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54be9a2c-c327-4249-ba65-0fc49162bac7 could not be found. May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54be9a2c-c327-4249-ba65-0fc49162bac7 could not be found. May 10 14:05:32.835549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:05:32.837764 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-631cbc30-fc18-433d-8df2-fe05ac05be10 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] Returning 404 to user: Instance 54be9a2c-c327-4249-ba65-0fc49162bac7 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:05:32.837764 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-631cbc30-fc18-433d-8df2-fe05ac05be10 tempest-ServerRescueNegativeTestJSON-1855127385 tempest-ServerRescueNegativeTestJSON-1855127385-project] 10.222.0.49 "GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7" status: 404 len: 111 microversion: 2.1 time: 0.031691 May 10 14:05:32.837764 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 412/801] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:05:32 2022] GET /compute/v2.1/servers/54be9a2c-c327-4249-ba65-0fc49162bac7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:05:33.295684 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8795e366-1f45-4fcc-a76d-56085649efa7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:33.296972 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8795e366-1f45-4fcc-a76d-56085649efa7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:33.308496 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8795e366-1f45-4fcc-a76d-56085649efa7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:33.309175 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8795e366-1f45-4fcc-a76d-56085649efa7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:33.310175 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8795e366-1f45-4fcc-a76d-56085649efa7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:33.312644 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8795e366-1f45-4fcc-a76d-56085649efa7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:33.539486 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8795e366-1f45-4fcc-a76d-56085649efa7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:33.547579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8795e366-1f45-4fcc-a76d-56085649efa7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:33.549266 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8795e366-1f45-4fcc-a76d-56085649efa7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:33.550585 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8795e366-1f45-4fcc-a76d-56085649efa7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.259251 May 10 14:05:33.551234 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 390/802] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:33 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:34.574519 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3c78f39b-bd02-4350-92fa-99e8e76f0b7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:34.576584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3c78f39b-bd02-4350-92fa-99e8e76f0b7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:34.585467 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3c78f39b-bd02-4350-92fa-99e8e76f0b7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:34.586342 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3c78f39b-bd02-4350-92fa-99e8e76f0b7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:34.587643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3c78f39b-bd02-4350-92fa-99e8e76f0b7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:34.588286 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3c78f39b-bd02-4350-92fa-99e8e76f0b7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:34.914962 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-d1cf539e-cd06-44dc-8c14-73ef78e769c1 req-a595c1da-861c-4ba0-91e4-2d88b9c18e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3b777f-9d47-4753-8fc8-27e7fabae486", "tag": "471a17c9-6251-41d8-9d93-8ecd7da310ca"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:34.927574 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-d1cf539e-cd06-44dc-8c14-73ef78e769c1 req-a595c1da-861c-4ba0-91e4-2d88b9c18e03 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:34.928022 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-d1cf539e-cd06-44dc-8c14-73ef78e769c1 req-a595c1da-861c-4ba0-91e4-2d88b9c18e03 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:34.953589 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-d1cf539e-cd06-44dc-8c14-73ef78e769c1 req-a595c1da-861c-4ba0-91e4-2d88b9c18e03 service nova] Creating event network-changed:471a17c9-6251-41d8-9d93-8ecd7da310ca for instance ad3b777f-9d47-4753-8fc8-27e7fabae486 on hv-cinder-84067 May 10 14:05:34.966863 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-d1cf539e-cd06-44dc-8c14-73ef78e769c1 req-a595c1da-861c-4ba0-91e4-2d88b9c18e03 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119042 May 10 14:05:34.967814 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 391/803] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:05:35.148081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3c78f39b-bd02-4350-92fa-99e8e76f0b7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:35.161321 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3c78f39b-bd02-4350-92fa-99e8e76f0b7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:35.164418 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3c78f39b-bd02-4350-92fa-99e8e76f0b7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:35.174881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3c78f39b-bd02-4350-92fa-99e8e76f0b7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.608102 May 10 14:05:35.177242 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 413/804] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:34 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:36.196315 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a2b49bf9-d0a3-4ae5-8099-60a939c264d3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:36.197093 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a2b49bf9-d0a3-4ae5-8099-60a939c264d3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:36.203951 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a2b49bf9-d0a3-4ae5-8099-60a939c264d3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:36.204528 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a2b49bf9-d0a3-4ae5-8099-60a939c264d3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:36.205654 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a2b49bf9-d0a3-4ae5-8099-60a939c264d3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:36.206364 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a2b49bf9-d0a3-4ae5-8099-60a939c264d3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:36.423315 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a2b49bf9-d0a3-4ae5-8099-60a939c264d3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:36.433494 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a2b49bf9-d0a3-4ae5-8099-60a939c264d3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:36.435353 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a2b49bf9-d0a3-4ae5-8099-60a939c264d3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:36.436708 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a2b49bf9-d0a3-4ae5-8099-60a939c264d3 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.244879 May 10 14:05:36.438086 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 392/805] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:36 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:37.012378 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-06056372-9b60-4a58-8cbe-b5b234361d6b req-5a96fd82-06e1-4f02-84e4-7ea54ce5f74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821e2fc1-0f9b-40f0-a08e-cb87df184140", "tag": "1b71aba5-cc9f-45c9-8184-f38605a005e7"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:37.022453 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-06056372-9b60-4a58-8cbe-b5b234361d6b req-5a96fd82-06e1-4f02-84e4-7ea54ce5f74d service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:37.022895 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-06056372-9b60-4a58-8cbe-b5b234361d6b req-5a96fd82-06e1-4f02-84e4-7ea54ce5f74d service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:37.039796 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-06056372-9b60-4a58-8cbe-b5b234361d6b req-5a96fd82-06e1-4f02-84e4-7ea54ce5f74d service nova] Creating event network-changed:1b71aba5-cc9f-45c9-8184-f38605a005e7 for instance 821e2fc1-0f9b-40f0-a08e-cb87df184140 on hv-cinder-84067 May 10 14:05:37.044847 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-06056372-9b60-4a58-8cbe-b5b234361d6b req-5a96fd82-06e1-4f02-84e4-7ea54ce5f74d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041138 May 10 14:05:37.048343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 414/806] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:37.455035 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-24bf9d78-1038-4350-a256-932da4e5ce09 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:37.455673 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-24bf9d78-1038-4350-a256-932da4e5ce09 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:37.462724 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-24bf9d78-1038-4350-a256-932da4e5ce09 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:37.463222 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-24bf9d78-1038-4350-a256-932da4e5ce09 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:37.464017 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-24bf9d78-1038-4350-a256-932da4e5ce09 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:37.464475 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-24bf9d78-1038-4350-a256-932da4e5ce09 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:37.674269 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-24bf9d78-1038-4350-a256-932da4e5ce09 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:37.684089 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-24bf9d78-1038-4350-a256-932da4e5ce09 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:37.685687 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-24bf9d78-1038-4350-a256-932da4e5ce09 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:37.686882 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-24bf9d78-1038-4350-a256-932da4e5ce09 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.235758 May 10 14:05:37.687446 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 393/807] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:37 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:38.707053 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cdae65da-0cae-457f-861c-4305a797d80d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:38.707748 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-cdae65da-0cae-457f-861c-4305a797d80d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:38.714496 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cdae65da-0cae-457f-861c-4305a797d80d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:38.714976 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cdae65da-0cae-457f-861c-4305a797d80d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:38.715754 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cdae65da-0cae-457f-861c-4305a797d80d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:38.716268 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cdae65da-0cae-457f-861c-4305a797d80d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:38.849988 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-cdae65da-0cae-457f-861c-4305a797d80d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:38.857840 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-cdae65da-0cae-457f-861c-4305a797d80d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:38.859292 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-cdae65da-0cae-457f-861c-4305a797d80d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:38.860658 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cdae65da-0cae-457f-861c-4305a797d80d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1745 microversion: 2.20 time: 0.158779 May 10 14:05:38.861218 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 415/808] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:38 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:39.882376 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e83313b0-ba0a-4817-8875-a8be90fb2692 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:39.884782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e83313b0-ba0a-4817-8875-a8be90fb2692 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:39.890908 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e83313b0-ba0a-4817-8875-a8be90fb2692 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:39.891529 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e83313b0-ba0a-4817-8875-a8be90fb2692 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:39.892490 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e83313b0-ba0a-4817-8875-a8be90fb2692 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:39.894359 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e83313b0-ba0a-4817-8875-a8be90fb2692 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:40.033418 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e83313b0-ba0a-4817-8875-a8be90fb2692 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:40.042827 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e83313b0-ba0a-4817-8875-a8be90fb2692 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:40.044497 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e83313b0-ba0a-4817-8875-a8be90fb2692 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:40.045753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e83313b0-ba0a-4817-8875-a8be90fb2692 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1745 microversion: 2.20 time: 0.169402 May 10 14:05:40.046422 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 394/809] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:39 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:41.071916 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-77024d98-20a0-4f02-9a1f-c4b7202297fa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:41.073144 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-77024d98-20a0-4f02-9a1f-c4b7202297fa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:41.082543 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-77024d98-20a0-4f02-9a1f-c4b7202297fa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:41.083242 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-77024d98-20a0-4f02-9a1f-c4b7202297fa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:41.084368 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-77024d98-20a0-4f02-9a1f-c4b7202297fa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:41.085030 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-77024d98-20a0-4f02-9a1f-c4b7202297fa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:41.229671 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-77024d98-20a0-4f02-9a1f-c4b7202297fa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:41.238665 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-77024d98-20a0-4f02-9a1f-c4b7202297fa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:41.240197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-77024d98-20a0-4f02-9a1f-c4b7202297fa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:41.241380 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-77024d98-20a0-4f02-9a1f-c4b7202297fa tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1740 microversion: 2.20 time: 0.180560 May 10 14:05:41.241949 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 416/810] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:41 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:42.259895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a2b0983b-8bea-4946-86fc-30aa175f0fd4 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:42.260940 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a2b0983b-8bea-4946-86fc-30aa175f0fd4 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:42.269366 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a2b0983b-8bea-4946-86fc-30aa175f0fd4 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:42.269956 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a2b0983b-8bea-4946-86fc-30aa175f0fd4 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:42.270981 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a2b0983b-8bea-4946-86fc-30aa175f0fd4 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:42.271518 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a2b0983b-8bea-4946-86fc-30aa175f0fd4 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:42.420966 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a2b0983b-8bea-4946-86fc-30aa175f0fd4 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:42.432154 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a2b0983b-8bea-4946-86fc-30aa175f0fd4 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:42.433768 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a2b0983b-8bea-4946-86fc-30aa175f0fd4 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:42.435158 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a2b0983b-8bea-4946-86fc-30aa175f0fd4 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1740 microversion: 2.20 time: 0.179027 May 10 14:05:42.435830 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 395/811] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:42 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:43.044822 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-be651368-4305-4f5c-b8e2-64c799b6520b req-2f42bd71-3e1c-472e-b914-275cac4be2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e6e847-c76f-441e-a7f8-63251b198a2d", "name": "network-vif-plugged", "status": "completed", "tag": "7c7e5879-9276-48c6-9f02-0be4571c330e"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:43.055131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-be651368-4305-4f5c-b8e2-64c799b6520b req-2f42bd71-3e1c-472e-b914-275cac4be2fa service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:43.056043 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-be651368-4305-4f5c-b8e2-64c799b6520b req-2f42bd71-3e1c-472e-b914-275cac4be2fa service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:43.073607 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-be651368-4305-4f5c-b8e2-64c799b6520b req-2f42bd71-3e1c-472e-b914-275cac4be2fa service nova] Creating event network-vif-plugged:7c7e5879-9276-48c6-9f02-0be4571c330e for instance 18e6e847-c76f-441e-a7f8-63251b198a2d on hv-cinder-84067 May 10 14:05:43.079252 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-be651368-4305-4f5c-b8e2-64c799b6520b req-2f42bd71-3e1c-472e-b914-275cac4be2fa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211094 May 10 14:05:43.080008 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 417/812] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:43.454812 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-46531549-feef-4fb9-b20c-91fcca8ee2c5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:43.455359 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-46531549-feef-4fb9-b20c-91fcca8ee2c5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:43.462794 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-46531549-feef-4fb9-b20c-91fcca8ee2c5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:43.463248 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-46531549-feef-4fb9-b20c-91fcca8ee2c5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:43.464570 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-46531549-feef-4fb9-b20c-91fcca8ee2c5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:43.465016 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-46531549-feef-4fb9-b20c-91fcca8ee2c5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:43.608687 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-46531549-feef-4fb9-b20c-91fcca8ee2c5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:43.618580 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-46531549-feef-4fb9-b20c-91fcca8ee2c5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:43.620457 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-46531549-feef-4fb9-b20c-91fcca8ee2c5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:43.621876 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-46531549-feef-4fb9-b20c-91fcca8ee2c5 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1740 microversion: 2.20 time: 0.171463 May 10 14:05:43.622875 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 396/813] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:43 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:44.645744 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0b583611-e849-4c3e-82fc-c7b58c7ee701 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:44.648545 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0b583611-e849-4c3e-82fc-c7b58c7ee701 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:44.655676 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0b583611-e849-4c3e-82fc-c7b58c7ee701 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:44.657105 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0b583611-e849-4c3e-82fc-c7b58c7ee701 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:44.658287 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0b583611-e849-4c3e-82fc-c7b58c7ee701 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:44.658798 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0b583611-e849-4c3e-82fc-c7b58c7ee701 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:44.832638 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0b583611-e849-4c3e-82fc-c7b58c7ee701 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:44.847954 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0b583611-e849-4c3e-82fc-c7b58c7ee701 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:44.849863 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0b583611-e849-4c3e-82fc-c7b58c7ee701 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:44.851112 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0b583611-e849-4c3e-82fc-c7b58c7ee701 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1740 microversion: 2.20 time: 0.214098 May 10 14:05:44.851908 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 418/814] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:44 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:45.414907 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1a65c9f1-c80f-44b4-a76e-98b6c950ce5b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:45.415400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1a65c9f1-c80f-44b4-a76e-98b6c950ce5b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:45.425012 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1a65c9f1-c80f-44b4-a76e-98b6c950ce5b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:45.425723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1a65c9f1-c80f-44b4-a76e-98b6c950ce5b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:45.426744 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1a65c9f1-c80f-44b4-a76e-98b6c950ce5b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:45.427359 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1a65c9f1-c80f-44b4-a76e-98b6c950ce5b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:45.453855 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1a65c9f1-c80f-44b4-a76e-98b6c950ce5b tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/ips" status: 200 len: 145 microversion: 2.1 time: 0.253459 May 10 14:05:45.455102 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 397/815] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 14:05:45 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/ips => generated 145 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:45.870323 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0e341739-6dc0-449e-9e62-883b58819c30 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:45.870940 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0e341739-6dc0-449e-9e62-883b58819c30 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:45.883371 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e341739-6dc0-449e-9e62-883b58819c30 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:45.883827 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e341739-6dc0-449e-9e62-883b58819c30 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:45.884651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e341739-6dc0-449e-9e62-883b58819c30 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:45.888054 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e341739-6dc0-449e-9e62-883b58819c30 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:46.105500 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0e341739-6dc0-449e-9e62-883b58819c30 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:46.114671 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0e341739-6dc0-449e-9e62-883b58819c30 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:46.116583 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0e341739-6dc0-449e-9e62-883b58819c30 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:46.118880 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0e341739-6dc0-449e-9e62-883b58819c30 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1740 microversion: 2.20 time: 0.252694 May 10 14:05:46.120221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 419/816] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:45 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:46.964964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-40205a6d-525d-4ab2-9a69-840eacafb46f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52def68c-c957-4e57-aa5f-af3ed714eb99"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:46.976379 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-40205a6d-525d-4ab2-9a69-840eacafb46f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:46.982487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40205a6d-525d-4ab2-9a69-840eacafb46f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:46.983047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40205a6d-525d-4ab2-9a69-840eacafb46f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:46.983981 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40205a6d-525d-4ab2-9a69-840eacafb46f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:46.984555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40205a6d-525d-4ab2-9a69-840eacafb46f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:47.141545 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-198ea612-5dce-43dd-a343-fb82a54a8ce9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:47.142161 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-198ea612-5dce-43dd-a343-fb82a54a8ce9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:47.149523 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-198ea612-5dce-43dd-a343-fb82a54a8ce9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:47.151250 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-198ea612-5dce-43dd-a343-fb82a54a8ce9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:47.151967 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-198ea612-5dce-43dd-a343-fb82a54a8ce9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:47.152592 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-198ea612-5dce-43dd-a343-fb82a54a8ce9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:47.332601 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-198ea612-5dce-43dd-a343-fb82a54a8ce9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:47.342836 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-198ea612-5dce-43dd-a343-fb82a54a8ce9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:47.344727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-198ea612-5dce-43dd-a343-fb82a54a8ce9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:47.345903 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-198ea612-5dce-43dd-a343-fb82a54a8ce9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1740 microversion: 2.20 time: 0.208441 May 10 14:05:47.347178 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 420/817] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:47 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:05:47.391330 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-40205a6d-525d-4ab2-9a69-840eacafb46f tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "POST /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430116 May 10 14:05:47.399891 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 398/818] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:05:46 2022] POST /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:48.366004 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5167c18f-b287-405a-8e84-e3958040018c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:48.366618 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5167c18f-b287-405a-8e84-e3958040018c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:48.375211 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5167c18f-b287-405a-8e84-e3958040018c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:48.375662 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5167c18f-b287-405a-8e84-e3958040018c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:48.376701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5167c18f-b287-405a-8e84-e3958040018c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:48.377290 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5167c18f-b287-405a-8e84-e3958040018c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:48.577230 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5167c18f-b287-405a-8e84-e3958040018c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:48.586633 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5167c18f-b287-405a-8e84-e3958040018c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:48.589799 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5167c18f-b287-405a-8e84-e3958040018c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:48.591470 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5167c18f-b287-405a-8e84-e3958040018c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1740 microversion: 2.20 time: 0.230020 May 10 14:05:48.592126 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 421/819] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:48 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:49.612815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-52d43bfa-283c-4984-9740-b83acf8eeac8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:49.615439 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-52d43bfa-283c-4984-9740-b83acf8eeac8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:49.627908 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-52d43bfa-283c-4984-9740-b83acf8eeac8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:49.628573 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-52d43bfa-283c-4984-9740-b83acf8eeac8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:49.629650 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-52d43bfa-283c-4984-9740-b83acf8eeac8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:49.630246 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-52d43bfa-283c-4984-9740-b83acf8eeac8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:49.820125 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-52d43bfa-283c-4984-9740-b83acf8eeac8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:49.831720 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-52d43bfa-283c-4984-9740-b83acf8eeac8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:49.833724 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-52d43bfa-283c-4984-9740-b83acf8eeac8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:49.835159 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-52d43bfa-283c-4984-9740-b83acf8eeac8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1740 microversion: 2.20 time: 0.229467 May 10 14:05:49.835914 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 399/820] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:49 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:50.853331 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3f7f71b0-f129-46ef-bb74-2669c8a50466 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:50.853981 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3f7f71b0-f129-46ef-bb74-2669c8a50466 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:50.859996 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3f7f71b0-f129-46ef-bb74-2669c8a50466 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:50.860496 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3f7f71b0-f129-46ef-bb74-2669c8a50466 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:50.861273 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3f7f71b0-f129-46ef-bb74-2669c8a50466 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:50.861764 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3f7f71b0-f129-46ef-bb74-2669c8a50466 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:50.995287 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3f7f71b0-f129-46ef-bb74-2669c8a50466 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:51.002907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3f7f71b0-f129-46ef-bb74-2669c8a50466 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:51.004458 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3f7f71b0-f129-46ef-bb74-2669c8a50466 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:51.005617 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3f7f71b0-f129-46ef-bb74-2669c8a50466 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1740 microversion: 2.20 time: 0.156147 May 10 14:05:51.006178 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 422/821] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:50 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:52.023405 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-aaf8d1da-5786-4a8a-bf91-ea23bc608949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:52.024301 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-aaf8d1da-5786-4a8a-bf91-ea23bc608949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:52.031096 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-aaf8d1da-5786-4a8a-bf91-ea23bc608949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:52.031548 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-aaf8d1da-5786-4a8a-bf91-ea23bc608949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:52.032373 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-aaf8d1da-5786-4a8a-bf91-ea23bc608949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:52.032816 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-aaf8d1da-5786-4a8a-bf91-ea23bc608949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:52.231189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-aaf8d1da-5786-4a8a-bf91-ea23bc608949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:52.239453 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-aaf8d1da-5786-4a8a-bf91-ea23bc608949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:52.240981 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-aaf8d1da-5786-4a8a-bf91-ea23bc608949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:52.242131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-aaf8d1da-5786-4a8a-bf91-ea23bc608949 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1722 microversion: 2.20 time: 0.222844 May 10 14:05:52.242700 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 400/822] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:52 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:53.261041 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-87e43211-4815-4f21-b755-763746c34bb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:53.261583 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-87e43211-4815-4f21-b755-763746c34bb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:53.267700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-87e43211-4815-4f21-b755-763746c34bb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:53.268467 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-87e43211-4815-4f21-b755-763746c34bb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:53.269224 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-87e43211-4815-4f21-b755-763746c34bb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:53.269665 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-87e43211-4815-4f21-b755-763746c34bb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:53.398998 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-87e43211-4815-4f21-b755-763746c34bb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:53.406878 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-87e43211-4815-4f21-b755-763746c34bb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:53.408391 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-87e43211-4815-4f21-b755-763746c34bb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:53.410027 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-87e43211-4815-4f21-b755-763746c34bb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1722 microversion: 2.20 time: 0.152944 May 10 14:05:53.410587 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 423/823] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:53 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:54.429783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3ca23534-2aa9-4894-a883-94e01dea26a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:54.430395 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-3ca23534-2aa9-4894-a883-94e01dea26a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:54.436828 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3ca23534-2aa9-4894-a883-94e01dea26a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:54.437286 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3ca23534-2aa9-4894-a883-94e01dea26a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:54.438245 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3ca23534-2aa9-4894-a883-94e01dea26a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:54.438686 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3ca23534-2aa9-4894-a883-94e01dea26a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:54.577586 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3ca23534-2aa9-4894-a883-94e01dea26a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:54.585444 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3ca23534-2aa9-4894-a883-94e01dea26a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:54.586982 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3ca23534-2aa9-4894-a883-94e01dea26a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:54.588413 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3ca23534-2aa9-4894-a883-94e01dea26a7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1725 microversion: 2.20 time: 0.163097 May 10 14:05:54.589088 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 401/824] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:54 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:05:54.606693 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0b625257-69d7-4f2b-aad9-60724fb96ac7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73e64b80-1313-4b76-a7d4-2e23d9fd66b2"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:54.608306 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0b625257-69d7-4f2b-aad9-60724fb96ac7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:54.615457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0b625257-69d7-4f2b-aad9-60724fb96ac7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:54.615905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0b625257-69d7-4f2b-aad9-60724fb96ac7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:54.616700 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0b625257-69d7-4f2b-aad9-60724fb96ac7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:54.617132 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0b625257-69d7-4f2b-aad9-60724fb96ac7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:54.869100 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-559c999f-5742-4fdd-bcd0-e5c3477b2978 req-e82f54a3-9f2b-4b1a-a49d-88600a85aee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e6e847-c76f-441e-a7f8-63251b198a2d", "name": "network-vif-unplugged", "status": "completed", "tag": "7c7e5879-9276-48c6-9f02-0be4571c330e"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:54.878541 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-559c999f-5742-4fdd-bcd0-e5c3477b2978 req-e82f54a3-9f2b-4b1a-a49d-88600a85aee5 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:54.879292 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-559c999f-5742-4fdd-bcd0-e5c3477b2978 req-e82f54a3-9f2b-4b1a-a49d-88600a85aee5 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:54.894700 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-559c999f-5742-4fdd-bcd0-e5c3477b2978 req-e82f54a3-9f2b-4b1a-a49d-88600a85aee5 service nova] Creating event network-vif-unplugged:7c7e5879-9276-48c6-9f02-0be4571c330e for instance 18e6e847-c76f-441e-a7f8-63251b198a2d on hv-cinder-84067 May 10 14:05:54.901482 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-559c999f-5742-4fdd-bcd0-e5c3477b2978 req-e82f54a3-9f2b-4b1a-a49d-88600a85aee5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036200 May 10 14:05:54.902837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 402/825] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:05:54.956523 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0b625257-69d7-4f2b-aad9-60724fb96ac7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "POST /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.353606 May 10 14:05:54.958628 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 424/826] 10.222.0.49 () {62 vars in 1363 bytes} [Tue May 10 14:05:54 2022] POST /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/os-volume_attachments => generated 188 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:05:55.029213 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9b835f17-a115-455b-a779-56b4a674da4e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:55.030634 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9b835f17-a115-455b-a779-56b4a674da4e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:55.037877 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9b835f17-a115-455b-a779-56b4a674da4e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:55.038325 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9b835f17-a115-455b-a779-56b4a674da4e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:55.039358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9b835f17-a115-455b-a779-56b4a674da4e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:55.039983 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9b835f17-a115-455b-a779-56b4a674da4e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:55.074564 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9b835f17-a115-455b-a779-56b4a674da4e tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051471 May 10 14:05:55.076414 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 403/827] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:05:55 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:55.086908 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e2a2fa75-924f-4c17-a503-fb918a942335 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:55.087396 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e2a2fa75-924f-4c17-a503-fb918a942335 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:55.094532 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e2a2fa75-924f-4c17-a503-fb918a942335 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:55.095179 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e2a2fa75-924f-4c17-a503-fb918a942335 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:55.096763 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e2a2fa75-924f-4c17-a503-fb918a942335 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:55.097383 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e2a2fa75-924f-4c17-a503-fb918a942335 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:55.103466 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ac5360d6-ed96-4af3-a120-1588f5afb13b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:55.103979 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ac5360d6-ed96-4af3-a120-1588f5afb13b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:55.112565 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ac5360d6-ed96-4af3-a120-1588f5afb13b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:55.113584 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ac5360d6-ed96-4af3-a120-1588f5afb13b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:55.114867 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ac5360d6-ed96-4af3-a120-1588f5afb13b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:55.115618 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ac5360d6-ed96-4af3-a120-1588f5afb13b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:55.140592 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e2a2fa75-924f-4c17-a503-fb918a942335 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments/52def68c-c957-4e57-aa5f-af3ed714eb99" status: 200 len: 194 microversion: 2.1 time: 0.054986 May 10 14:05:55.141989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 425/828] 10.222.0.49 () {58 vars in 1412 bytes} [Tue May 10 14:05:55 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments/52def68c-c957-4e57-aa5f-af3ed714eb99 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:55.418028 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ac5360d6-ed96-4af3-a120-1588f5afb13b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "DELETE /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/os-volume_attachments/73e64b80-1313-4b76-a7d4-2e23d9fd66b2" status: 202 len: 0 microversion: 2.20 time: 0.318357 May 10 14:05:55.418964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 404/829] 10.222.0.49 () {60 vars in 1456 bytes} [Tue May 10 14:05:55 2022] DELETE /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/os-volume_attachments/73e64b80-1313-4b76-a7d4-2e23d9fd66b2 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 14:05:55.489917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5359657f-0770-49a5-aa8f-5ad3a967019c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:55.490500 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5359657f-0770-49a5-aa8f-5ad3a967019c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:55.509244 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5359657f-0770-49a5-aa8f-5ad3a967019c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:55.509706 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5359657f-0770-49a5-aa8f-5ad3a967019c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:55.510511 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5359657f-0770-49a5-aa8f-5ad3a967019c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:55.510960 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5359657f-0770-49a5-aa8f-5ad3a967019c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:55.778213 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5359657f-0770-49a5-aa8f-5ad3a967019c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "POST /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/action" status: 202 len: 0 microversion: 2.20 time: 0.292264 May 10 14:05:55.779320 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 426/830] 10.222.0.49 () {62 vars in 1318 bytes} [Tue May 10 14:05:55 2022] POST /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 14:05:55.789535 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-62030c1e-f00d-403a-b47c-7a08a04bfc14 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:55.790094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-62030c1e-f00d-403a-b47c-7a08a04bfc14 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:55.797867 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-62030c1e-f00d-403a-b47c-7a08a04bfc14 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:55.798720 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-62030c1e-f00d-403a-b47c-7a08a04bfc14 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:55.800297 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-62030c1e-f00d-403a-b47c-7a08a04bfc14 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:55.801957 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-62030c1e-f00d-403a-b47c-7a08a04bfc14 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:56.027709 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-62030c1e-f00d-403a-b47c-7a08a04bfc14 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:56.039771 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-62030c1e-f00d-403a-b47c-7a08a04bfc14 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:56.041346 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-62030c1e-f00d-403a-b47c-7a08a04bfc14 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:56.043156 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-62030c1e-f00d-403a-b47c-7a08a04bfc14 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1673 microversion: 2.20 time: 0.259724 May 10 14:05:56.043726 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 405/831] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:55 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1673 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:05:56.576871 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-374811ab-1289-428c-8104-12d4adbaa3bf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7096996f-ec96-4ae2-939c-6fe617439773"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:56.577995 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-374811ab-1289-428c-8104-12d4adbaa3bf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:56.584664 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-374811ab-1289-428c-8104-12d4adbaa3bf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:56.585123 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-374811ab-1289-428c-8104-12d4adbaa3bf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:56.585904 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-374811ab-1289-428c-8104-12d4adbaa3bf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:56.586347 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-374811ab-1289-428c-8104-12d4adbaa3bf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:57.061878 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8811feda-1f27-4c8d-a8f3-ff9d101d88f0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:57.062490 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8811feda-1f27-4c8d-a8f3-ff9d101d88f0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:57.069379 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8811feda-1f27-4c8d-a8f3-ff9d101d88f0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:57.070085 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8811feda-1f27-4c8d-a8f3-ff9d101d88f0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:57.070875 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8811feda-1f27-4c8d-a8f3-ff9d101d88f0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:57.071317 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8811feda-1f27-4c8d-a8f3-ff9d101d88f0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:57.078628 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-374811ab-1289-428c-8104-12d4adbaa3bf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "POST /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.507825 May 10 14:05:57.079476 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 427/832] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:05:56 2022] POST /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments => generated 194 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:05:57.288623 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8811feda-1f27-4c8d-a8f3-ff9d101d88f0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:57.298354 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8811feda-1f27-4c8d-a8f3-ff9d101d88f0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:57.299825 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8811feda-1f27-4c8d-a8f3-ff9d101d88f0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:57.301024 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8811feda-1f27-4c8d-a8f3-ff9d101d88f0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.243293 May 10 14:05:57.302076 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 406/833] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:57 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:05:58.324451 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-047ccce5-2e94-4d0c-8266-b6781d2a79d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:58.325996 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-047ccce5-2e94-4d0c-8266-b6781d2a79d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:58.338574 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-047ccce5-2e94-4d0c-8266-b6781d2a79d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:58.339106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-047ccce5-2e94-4d0c-8266-b6781d2a79d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:58.339930 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-047ccce5-2e94-4d0c-8266-b6781d2a79d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:58.340429 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-047ccce5-2e94-4d0c-8266-b6781d2a79d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:58.568770 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-047ccce5-2e94-4d0c-8266-b6781d2a79d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:58.577110 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-047ccce5-2e94-4d0c-8266-b6781d2a79d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:58.578907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-047ccce5-2e94-4d0c-8266-b6781d2a79d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:58.580506 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-047ccce5-2e94-4d0c-8266-b6781d2a79d8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.263955 May 10 14:05:58.581182 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 428/834] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:58 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:05:59.600747 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2fc130b5-9e2c-464b-8331-dddba30e0564 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:59.601487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2fc130b5-9e2c-464b-8331-dddba30e0564 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:59.608017 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2fc130b5-9e2c-464b-8331-dddba30e0564 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:59.608792 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2fc130b5-9e2c-464b-8331-dddba30e0564 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:59.609955 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2fc130b5-9e2c-464b-8331-dddba30e0564 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:59.610572 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2fc130b5-9e2c-464b-8331-dddba30e0564 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:59.771549 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2fc130b5-9e2c-464b-8331-dddba30e0564 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:59.780184 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2fc130b5-9e2c-464b-8331-dddba30e0564 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:59.781792 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2fc130b5-9e2c-464b-8331-dddba30e0564 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:59.783192 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2fc130b5-9e2c-464b-8331-dddba30e0564 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.187428 May 10 14:05:59.784613 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 407/835] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:05:59 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:00.805119 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2e6ea502-98af-4086-b72f-556ec574fe3b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:00.805750 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2e6ea502-98af-4086-b72f-556ec574fe3b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:00.812803 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2e6ea502-98af-4086-b72f-556ec574fe3b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:00.816893 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2e6ea502-98af-4086-b72f-556ec574fe3b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:00.817741 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2e6ea502-98af-4086-b72f-556ec574fe3b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:00.818193 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2e6ea502-98af-4086-b72f-556ec574fe3b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:00.987290 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2e6ea502-98af-4086-b72f-556ec574fe3b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:00.998630 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2e6ea502-98af-4086-b72f-556ec574fe3b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:01.000726 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2e6ea502-98af-4086-b72f-556ec574fe3b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:01.002137 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2e6ea502-98af-4086-b72f-556ec574fe3b tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.203298 May 10 14:06:01.003079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 429/836] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:00 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:02.020716 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-862a0be1-339e-4a21-b3df-70c941fbc775 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:02.021959 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-862a0be1-339e-4a21-b3df-70c941fbc775 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:02.029044 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-862a0be1-339e-4a21-b3df-70c941fbc775 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:02.029733 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-862a0be1-339e-4a21-b3df-70c941fbc775 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:02.030990 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-862a0be1-339e-4a21-b3df-70c941fbc775 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:02.031596 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-862a0be1-339e-4a21-b3df-70c941fbc775 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:02.222557 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-862a0be1-339e-4a21-b3df-70c941fbc775 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:02.235390 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-862a0be1-339e-4a21-b3df-70c941fbc775 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:02.241844 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-862a0be1-339e-4a21-b3df-70c941fbc775 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:02.245253 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-862a0be1-339e-4a21-b3df-70c941fbc775 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.229264 May 10 14:06:02.246879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 408/837] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:02 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:03.263755 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-b82a08a2-5368-4e14-a1fa-1e129c4e9f07 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:03.264396 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-b82a08a2-5368-4e14-a1fa-1e129c4e9f07 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:03.271365 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b82a08a2-5368-4e14-a1fa-1e129c4e9f07 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:03.271826 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b82a08a2-5368-4e14-a1fa-1e129c4e9f07 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:03.272650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b82a08a2-5368-4e14-a1fa-1e129c4e9f07 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:03.273095 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b82a08a2-5368-4e14-a1fa-1e129c4e9f07 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:03.444832 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-b82a08a2-5368-4e14-a1fa-1e129c4e9f07 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:03.452690 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-b82a08a2-5368-4e14-a1fa-1e129c4e9f07 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:03.463603 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-b82a08a2-5368-4e14-a1fa-1e129c4e9f07 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:03.464861 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-b82a08a2-5368-4e14-a1fa-1e129c4e9f07 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.205062 May 10 14:06:03.465939 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 430/838] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:03 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:04.482969 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-84ae023f-5075-4d6d-8b68-267010516790 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:04.483867 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-84ae023f-5075-4d6d-8b68-267010516790 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:04.496393 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-84ae023f-5075-4d6d-8b68-267010516790 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:04.496922 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-84ae023f-5075-4d6d-8b68-267010516790 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:04.497785 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-84ae023f-5075-4d6d-8b68-267010516790 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:04.498446 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-84ae023f-5075-4d6d-8b68-267010516790 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:04.682701 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-84ae023f-5075-4d6d-8b68-267010516790 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:04.694113 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-84ae023f-5075-4d6d-8b68-267010516790 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:04.697614 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-84ae023f-5075-4d6d-8b68-267010516790 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:04.699645 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-84ae023f-5075-4d6d-8b68-267010516790 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.220383 May 10 14:06:04.700405 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 409/839] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:04 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:05.718163 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-877dae57-5d4e-43cc-9587-1f797bab9866 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:05.718855 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-877dae57-5d4e-43cc-9587-1f797bab9866 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:05.726035 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-877dae57-5d4e-43cc-9587-1f797bab9866 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:05.726557 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-877dae57-5d4e-43cc-9587-1f797bab9866 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:05.727399 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-877dae57-5d4e-43cc-9587-1f797bab9866 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:05.727907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-877dae57-5d4e-43cc-9587-1f797bab9866 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:05.860254 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-877dae57-5d4e-43cc-9587-1f797bab9866 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:05.869443 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-877dae57-5d4e-43cc-9587-1f797bab9866 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:05.870933 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-877dae57-5d4e-43cc-9587-1f797bab9866 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:05.872094 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-877dae57-5d4e-43cc-9587-1f797bab9866 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.158023 May 10 14:06:05.872694 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 431/840] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:05 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:06.280772 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1073578713", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "networks": [{"uuid": "b4c49f8d-1bc6-48e0-93de-59cbffeeeacc"}]}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:06.333473 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.network.neutron [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] validate_networks() for [('b4c49f8d-1bc6-48e0-93de-59cbffeeeacc', None, None, None, None, None)] {{(pid=117153) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:06:06.750068 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Flavor limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:06:06.750693 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Image limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:06:06.751352 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Flavor pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:06:06.752483 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Image pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:06:06.753074 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:06:06.761855 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:06.762300 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:06.763103 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:06.763541 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:06.780647 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Getting quotas for project 7a263551cedd420db2fb5b24a60835b8. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:06:06.784624 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Getting quotas for user 2ff9c506880e45bd87a16af67e107eec and project 7a263551cedd420db2fb5b24a60835b8. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:06:06.795613 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Going to run 1 instances... {{(pid=117153) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:06:06.797903 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:06:06.847996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8310057c-d805-404f-8cc5-95f8ce5ee048 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570893 May 10 14:06:06.848728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 410/841] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:06:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:06:06.858497 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1fd721eb-c5c1-4847-b926-8a4f4578317b tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:06.859155 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1fd721eb-c5c1-4847-b926-8a4f4578317b tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:06.891041 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b6174683-c8db-4d6e-8d20-dfd4f7c6b5f8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:06.891644 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b6174683-c8db-4d6e-8d20-dfd4f7c6b5f8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:06.900841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6174683-c8db-4d6e-8d20-dfd4f7c6b5f8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:06.901294 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6174683-c8db-4d6e-8d20-dfd4f7c6b5f8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:06.902074 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6174683-c8db-4d6e-8d20-dfd4f7c6b5f8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:06.902573 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6174683-c8db-4d6e-8d20-dfd4f7c6b5f8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:06.928064 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1fd721eb-c5c1-4847-b926-8a4f4578317b tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:06.934598 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1fd721eb-c5c1-4847-b926-8a4f4578317b tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1214 microversion: 2.1 time: 0.079921 May 10 14:06:06.935286 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 432/842] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:06 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:07.047368 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b6174683-c8db-4d6e-8d20-dfd4f7c6b5f8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:07.056779 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b6174683-c8db-4d6e-8d20-dfd4f7c6b5f8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:07.058655 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b6174683-c8db-4d6e-8d20-dfd4f7c6b5f8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:07.059903 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b6174683-c8db-4d6e-8d20-dfd4f7c6b5f8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.172662 May 10 14:06:07.060690 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 411/843] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:06 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:07.952829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e0875a1f-437e-4e9e-92a3-5e12d7a34c8e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:07.953468 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e0875a1f-437e-4e9e-92a3-5e12d7a34c8e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:07.960812 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e0875a1f-437e-4e9e-92a3-5e12d7a34c8e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:07.961256 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e0875a1f-437e-4e9e-92a3-5e12d7a34c8e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:07.962018 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e0875a1f-437e-4e9e-92a3-5e12d7a34c8e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:07.962453 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e0875a1f-437e-4e9e-92a3-5e12d7a34c8e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:08.078937 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9e8d56e2-95ca-4e70-9cc8-f6f8897d38e9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:08.079553 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9e8d56e2-95ca-4e70-9cc8-f6f8897d38e9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:08.086699 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e8d56e2-95ca-4e70-9cc8-f6f8897d38e9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:08.087150 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e8d56e2-95ca-4e70-9cc8-f6f8897d38e9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:08.087940 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e8d56e2-95ca-4e70-9cc8-f6f8897d38e9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:08.088416 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9e8d56e2-95ca-4e70-9cc8-f6f8897d38e9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:08.229455 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9e8d56e2-95ca-4e70-9cc8-f6f8897d38e9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:08.237451 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9e8d56e2-95ca-4e70-9cc8-f6f8897d38e9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:08.238960 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9e8d56e2-95ca-4e70-9cc8-f6f8897d38e9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:08.240133 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9e8d56e2-95ca-4e70-9cc8-f6f8897d38e9 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.165119 May 10 14:06:08.240726 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 412/844] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:08 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:06:08.291722 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e0875a1f-437e-4e9e-92a3-5e12d7a34c8e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:08.299059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e0875a1f-437e-4e9e-92a3-5e12d7a34c8e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1210 microversion: 2.1 time: 0.350156 May 10 14:06:08.299644 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 433/845] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:07 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1210 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:09.258205 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1644ef9f-cbe0-4e21-b0ce-e2429e6d95cd tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:09.258812 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1644ef9f-cbe0-4e21-b0ce-e2429e6d95cd tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:09.266135 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1644ef9f-cbe0-4e21-b0ce-e2429e6d95cd tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:09.266135 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1644ef9f-cbe0-4e21-b0ce-e2429e6d95cd tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:09.266511 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1644ef9f-cbe0-4e21-b0ce-e2429e6d95cd tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:09.267703 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1644ef9f-cbe0-4e21-b0ce-e2429e6d95cd tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:09.316829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-241174d7-5032-4753-876c-490cefbe7e02 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:09.317412 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-241174d7-5032-4753-876c-490cefbe7e02 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:09.326064 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-241174d7-5032-4753-876c-490cefbe7e02 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:09.326680 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-241174d7-5032-4753-876c-490cefbe7e02 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:09.327483 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-241174d7-5032-4753-876c-490cefbe7e02 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:09.327929 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-241174d7-5032-4753-876c-490cefbe7e02 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:09.431184 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-241174d7-5032-4753-876c-490cefbe7e02 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:09.440562 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-241174d7-5032-4753-876c-490cefbe7e02 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1266 microversion: 2.1 time: 0.128704 May 10 14:06:09.442961 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 434/846] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:09 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:09.444905 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1644ef9f-cbe0-4e21-b0ce-e2429e6d95cd tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:09.452802 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1644ef9f-cbe0-4e21-b0ce-e2429e6d95cd tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:09.455062 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1644ef9f-cbe0-4e21-b0ce-e2429e6d95cd tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:09.456408 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1644ef9f-cbe0-4e21-b0ce-e2429e6d95cd tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.202161 May 10 14:06:09.466726 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 413/847] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:09 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:09.978832 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2c405866-7532-4c15-a481-d3d738678a08 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:09.979957 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2c405866-7532-4c15-a481-d3d738678a08 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:09.987012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2c405866-7532-4c15-a481-d3d738678a08 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:09.987467 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2c405866-7532-4c15-a481-d3d738678a08 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:09.988268 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2c405866-7532-4c15-a481-d3d738678a08 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:09.988706 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2c405866-7532-4c15-a481-d3d738678a08 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:10.022114 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2c405866-7532-4c15-a481-d3d738678a08 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047242 May 10 14:06:10.022927 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 435/848] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:06:09 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:06:10.160989 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2bfcb226-a3ff-4c3f-ad7f-ae12beb301b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:10.161477 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2bfcb226-a3ff-4c3f-ad7f-ae12beb301b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:10.167195 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2bfcb226-a3ff-4c3f-ad7f-ae12beb301b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:10.167647 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2bfcb226-a3ff-4c3f-ad7f-ae12beb301b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:10.168449 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2bfcb226-a3ff-4c3f-ad7f-ae12beb301b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:10.168885 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2bfcb226-a3ff-4c3f-ad7f-ae12beb301b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:10.197065 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2bfcb226-a3ff-4c3f-ad7f-ae12beb301b0 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments/52def68c-c957-4e57-aa5f-af3ed714eb99" status: 200 len: 194 microversion: 2.1 time: 0.040054 May 10 14:06:10.197659 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 414/849] 10.222.0.49 () {58 vars in 1412 bytes} [Tue May 10 14:06:10 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments/52def68c-c957-4e57-aa5f-af3ed714eb99 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:10.207427 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ac8ce614-f3f1-4432-9353-7cace8755afb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:10.207927 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ac8ce614-f3f1-4432-9353-7cace8755afb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:10.213802 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ac8ce614-f3f1-4432-9353-7cace8755afb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:10.214261 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ac8ce614-f3f1-4432-9353-7cace8755afb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:10.215042 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ac8ce614-f3f1-4432-9353-7cace8755afb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:10.215483 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ac8ce614-f3f1-4432-9353-7cace8755afb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:10.300598 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-ac8ce614-f3f1-4432-9353-7cace8755afb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lazy-loading 'services' on Instance uuid 64e15393-bc14-4433-b2aa-6d8fb202b9ea {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:06:10.377019 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ac8ce614-f3f1-4432-9353-7cace8755afb tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "DELETE /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments/52def68c-c957-4e57-aa5f-af3ed714eb99" status: 202 len: 0 microversion: 2.1 time: 0.173409 May 10 14:06:10.377799 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 436/850] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 14:06:10 2022] DELETE /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments/52def68c-c957-4e57-aa5f-af3ed714eb99 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:06:10.457838 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e22c17f5-050b-4a06-8b88-d2e1b8cf0cf1 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:10.458454 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e22c17f5-050b-4a06-8b88-d2e1b8cf0cf1 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:10.464815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e22c17f5-050b-4a06-8b88-d2e1b8cf0cf1 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:10.465291 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e22c17f5-050b-4a06-8b88-d2e1b8cf0cf1 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:10.466062 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e22c17f5-050b-4a06-8b88-d2e1b8cf0cf1 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:10.466498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e22c17f5-050b-4a06-8b88-d2e1b8cf0cf1 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:10.474771 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0f7109a9-97e7-468a-a632-5f2b67b58011 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:10.475533 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0f7109a9-97e7-468a-a632-5f2b67b58011 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:10.482094 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f7109a9-97e7-468a-a632-5f2b67b58011 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:10.482790 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f7109a9-97e7-468a-a632-5f2b67b58011 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:10.483959 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f7109a9-97e7-468a-a632-5f2b67b58011 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:10.484566 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f7109a9-97e7-468a-a632-5f2b67b58011 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:10.621327 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0f7109a9-97e7-468a-a632-5f2b67b58011 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:10.630412 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0f7109a9-97e7-468a-a632-5f2b67b58011 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:10.631962 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0f7109a9-97e7-468a-a632-5f2b67b58011 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:10.633461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0f7109a9-97e7-468a-a632-5f2b67b58011 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.163463 May 10 14:06:10.634039 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 437/851] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:10 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:06:10.708223 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e22c17f5-050b-4a06-8b88-d2e1b8cf0cf1 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:10.715437 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e22c17f5-050b-4a06-8b88-d2e1b8cf0cf1 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1314 microversion: 2.1 time: 0.261608 May 10 14:06:10.716042 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 415/852] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:10 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:11.082984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-1f100dee-6f91-4978-a758-1b426acf3ed3 req-ba36de85-6749-4cb5-adb7-00f4e45a3774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b29c8399-ee26-419a-8313-ddd62ae80996", "tag": "a0fb9723-3a5f-41a6-8899-41ae9a308684"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:11.091467 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-1f100dee-6f91-4978-a758-1b426acf3ed3 req-ba36de85-6749-4cb5-adb7-00f4e45a3774 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:11.092039 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-1f100dee-6f91-4978-a758-1b426acf3ed3 req-ba36de85-6749-4cb5-adb7-00f4e45a3774 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:11.110224 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-1f100dee-6f91-4978-a758-1b426acf3ed3 req-ba36de85-6749-4cb5-adb7-00f4e45a3774 service nova] Creating event network-changed:a0fb9723-3a5f-41a6-8899-41ae9a308684 for instance b29c8399-ee26-419a-8313-ddd62ae80996 on hv-cinder-84067 May 10 14:06:11.115003 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-1f100dee-6f91-4978-a758-1b426acf3ed3 req-ba36de85-6749-4cb5-adb7-00f4e45a3774 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036574 May 10 14:06:11.115696 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 438/853] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:11.397990 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-adb5e331-ea66-4ee5-a52f-8dbc2165494e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:11.398662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-adb5e331-ea66-4ee5-a52f-8dbc2165494e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:11.404554 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-adb5e331-ea66-4ee5-a52f-8dbc2165494e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:11.405668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-adb5e331-ea66-4ee5-a52f-8dbc2165494e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:11.406511 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-adb5e331-ea66-4ee5-a52f-8dbc2165494e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:11.407015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-adb5e331-ea66-4ee5-a52f-8dbc2165494e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:11.429670 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-adb5e331-ea66-4ee5-a52f-8dbc2165494e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486/ips" status: 200 len: 149 microversion: 2.1 time: 0.035578 May 10 14:06:11.430335 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 416/854] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 14:06:11 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:06:11.653489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d1c6d44a-3494-4337-83c2-bdbb020f4862 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:11.654767 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d1c6d44a-3494-4337-83c2-bdbb020f4862 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:11.660978 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d1c6d44a-3494-4337-83c2-bdbb020f4862 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:11.661626 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d1c6d44a-3494-4337-83c2-bdbb020f4862 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:11.662845 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d1c6d44a-3494-4337-83c2-bdbb020f4862 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:11.663285 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d1c6d44a-3494-4337-83c2-bdbb020f4862 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:11.733500 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1d5d242d-f1ea-425e-b42c-e8191bc0feb7 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:11.734064 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1d5d242d-f1ea-425e-b42c-e8191bc0feb7 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:11.747637 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1d5d242d-f1ea-425e-b42c-e8191bc0feb7 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:11.748290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1d5d242d-f1ea-425e-b42c-e8191bc0feb7 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:11.749260 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1d5d242d-f1ea-425e-b42c-e8191bc0feb7 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:11.749847 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1d5d242d-f1ea-425e-b42c-e8191bc0feb7 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:11.869115 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d1c6d44a-3494-4337-83c2-bdbb020f4862 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:11.878280 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d1c6d44a-3494-4337-83c2-bdbb020f4862 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:11.880537 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d1c6d44a-3494-4337-83c2-bdbb020f4862 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:11.882263 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d1c6d44a-3494-4337-83c2-bdbb020f4862 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.234611 May 10 14:06:11.883382 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 439/855] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:11 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:12.002496 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1d5d242d-f1ea-425e-b42c-e8191bc0feb7 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:12.009775 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1d5d242d-f1ea-425e-b42c-e8191bc0feb7 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1314 microversion: 2.1 time: 0.280261 May 10 14:06:12.010332 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 417/856] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:11 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:12.542293 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cca186a5-2f88-4875-bfc1-5aa2d1c3ce5a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:12.542792 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-cca186a5-2f88-4875-bfc1-5aa2d1c3ce5a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:12.548640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cca186a5-2f88-4875-bfc1-5aa2d1c3ce5a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:12.549098 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cca186a5-2f88-4875-bfc1-5aa2d1c3ce5a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:12.549880 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cca186a5-2f88-4875-bfc1-5aa2d1c3ce5a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:12.550323 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cca186a5-2f88-4875-bfc1-5aa2d1c3ce5a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:12.579093 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cca186a5-2f88-4875-bfc1-5aa2d1c3ce5a tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments/7096996f-ec96-4ae2-939c-6fe617439773" status: 200 len: 194 microversion: 2.1 time: 0.040809 May 10 14:06:12.580268 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 440/857] 10.222.0.49 () {58 vars in 1412 bytes} [Tue May 10 14:06:12 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments/7096996f-ec96-4ae2-939c-6fe617439773 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:12.589920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-aa5b98f4-3a8c-4e48-8fb9-701dd20eb1c8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:12.590418 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-aa5b98f4-3a8c-4e48-8fb9-701dd20eb1c8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:12.596360 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-aa5b98f4-3a8c-4e48-8fb9-701dd20eb1c8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:12.596813 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-aa5b98f4-3a8c-4e48-8fb9-701dd20eb1c8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:12.597586 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-aa5b98f4-3a8c-4e48-8fb9-701dd20eb1c8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:12.598032 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-aa5b98f4-3a8c-4e48-8fb9-701dd20eb1c8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:12.673432 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-aa5b98f4-3a8c-4e48-8fb9-701dd20eb1c8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lazy-loading 'services' on Instance uuid 64e15393-bc14-4433-b2aa-6d8fb202b9ea {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:06:12.741526 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-aa5b98f4-3a8c-4e48-8fb9-701dd20eb1c8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "DELETE /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments/7096996f-ec96-4ae2-939c-6fe617439773" status: 202 len: 0 microversion: 2.1 time: 0.155318 May 10 14:06:12.742178 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 418/858] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 14:06:12 2022] DELETE /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments/7096996f-ec96-4ae2-939c-6fe617439773 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:06:12.845633 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5727eb5c-b580-40c6-8c64-9a841c315473 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37a980da-345a-4408-a4e6-f147bed343ad"}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:12.846761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5727eb5c-b580-40c6-8c64-9a841c315473 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:12.853071 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5727eb5c-b580-40c6-8c64-9a841c315473 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:12.853526 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5727eb5c-b580-40c6-8c64-9a841c315473 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:12.854303 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5727eb5c-b580-40c6-8c64-9a841c315473 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:12.854743 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5727eb5c-b580-40c6-8c64-9a841c315473 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:12.900509 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ff3aad4a-430d-4e2a-9a9f-4190a9160df8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:12.901200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ff3aad4a-430d-4e2a-9a9f-4190a9160df8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:12.907883 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ff3aad4a-430d-4e2a-9a9f-4190a9160df8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:12.908562 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ff3aad4a-430d-4e2a-9a9f-4190a9160df8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:12.909459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ff3aad4a-430d-4e2a-9a9f-4190a9160df8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:12.909888 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ff3aad4a-430d-4e2a-9a9f-4190a9160df8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:13.055691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ff3aad4a-430d-4e2a-9a9f-4190a9160df8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:13.070840 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ff3aad4a-430d-4e2a-9a9f-4190a9160df8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:13.072754 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ff3aad4a-430d-4e2a-9a9f-4190a9160df8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:13.074048 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ff3aad4a-430d-4e2a-9a9f-4190a9160df8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.177728 May 10 14:06:13.075035 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 419/859] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:12 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:06:13.080816 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e2a9974d-82b3-4073-86a7-7dd9d477d777 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:13.081836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e2a9974d-82b3-4073-86a7-7dd9d477d777 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:13.090443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2a9974d-82b3-4073-86a7-7dd9d477d777 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:13.091256 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2a9974d-82b3-4073-86a7-7dd9d477d777 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:13.092231 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2a9974d-82b3-4073-86a7-7dd9d477d777 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:13.092827 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2a9974d-82b3-4073-86a7-7dd9d477d777 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:13.174688 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5727eb5c-b580-40c6-8c64-9a841c315473 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "POST /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332691 May 10 14:06:13.175723 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 441/860] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:06:12 2022] POST /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:13.181022 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-e5862e45-5ced-485f-8a33-449535712284 req-0585db6c-1334-4981-b538-13f756a1949c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e6e847-c76f-441e-a7f8-63251b198a2d", "name": "network-vif-plugged", "status": "completed", "tag": "7c7e5879-9276-48c6-9f02-0be4571c330e"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:13.191453 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-e5862e45-5ced-485f-8a33-449535712284 req-0585db6c-1334-4981-b538-13f756a1949c service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:13.192327 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-e5862e45-5ced-485f-8a33-449535712284 req-0585db6c-1334-4981-b538-13f756a1949c service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:13.205702 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-e5862e45-5ced-485f-8a33-449535712284 req-0585db6c-1334-4981-b538-13f756a1949c service nova] Creating event network-vif-plugged:7c7e5879-9276-48c6-9f02-0be4571c330e for instance 18e6e847-c76f-441e-a7f8-63251b198a2d on hv-cinder-84067 May 10 14:06:13.210746 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-e5862e45-5ced-485f-8a33-449535712284 req-0585db6c-1334-4981-b538-13f756a1949c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033423 May 10 14:06:13.211427 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 442/861] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:13.243448 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e2a9974d-82b3-4073-86a7-7dd9d477d777 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:13.250738 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e2a9974d-82b3-4073-86a7-7dd9d477d777 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1314 microversion: 2.1 time: 0.174152 May 10 14:06:13.251907 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 420/862] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:13 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:14.093735 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8a9d8036-dba0-4505-948e-b9c43b338b61 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:14.094356 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8a9d8036-dba0-4505-948e-b9c43b338b61 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:14.100473 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8a9d8036-dba0-4505-948e-b9c43b338b61 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:14.100920 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8a9d8036-dba0-4505-948e-b9c43b338b61 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:14.101678 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8a9d8036-dba0-4505-948e-b9c43b338b61 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:14.102112 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8a9d8036-dba0-4505-948e-b9c43b338b61 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:14.230273 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8a9d8036-dba0-4505-948e-b9c43b338b61 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:14.239024 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8a9d8036-dba0-4505-948e-b9c43b338b61 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:14.240557 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8a9d8036-dba0-4505-948e-b9c43b338b61 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:14.241723 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8a9d8036-dba0-4505-948e-b9c43b338b61 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.152743 May 10 14:06:14.242561 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 443/863] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:14 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:14.269633 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4b19a398-5eb8-4003-9b86-7c9d9442d07f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:14.270392 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4b19a398-5eb8-4003-9b86-7c9d9442d07f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:14.286849 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4b19a398-5eb8-4003-9b86-7c9d9442d07f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:14.286849 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4b19a398-5eb8-4003-9b86-7c9d9442d07f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:14.287602 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4b19a398-5eb8-4003-9b86-7c9d9442d07f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:14.288040 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4b19a398-5eb8-4003-9b86-7c9d9442d07f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:14.417804 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4b19a398-5eb8-4003-9b86-7c9d9442d07f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:14.425615 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4b19a398-5eb8-4003-9b86-7c9d9442d07f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1314 microversion: 2.1 time: 0.160844 May 10 14:06:14.426182 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 421/864] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:14 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:14.945607 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-4b45352f-827b-499b-8af7-d4514339d3d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:14.946530 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-4b45352f-827b-499b-8af7-d4514339d3d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:14.952819 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4b45352f-827b-499b-8af7-d4514339d3d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:14.953266 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4b45352f-827b-499b-8af7-d4514339d3d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:14.954035 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4b45352f-827b-499b-8af7-d4514339d3d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:14.954498 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4b45352f-827b-499b-8af7-d4514339d3d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:14.991558 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-4b45352f-827b-499b-8af7-d4514339d3d9 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049518 May 10 14:06:14.991882 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 444/865] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:06:14 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:06:15.106564 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d01fc3d9-49a6-4f7e-b4c6-6714737a5633 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:15.107593 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d01fc3d9-49a6-4f7e-b4c6-6714737a5633 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:15.113642 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d01fc3d9-49a6-4f7e-b4c6-6714737a5633 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:15.114274 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d01fc3d9-49a6-4f7e-b4c6-6714737a5633 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:15.115320 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d01fc3d9-49a6-4f7e-b4c6-6714737a5633 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:15.115970 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d01fc3d9-49a6-4f7e-b4c6-6714737a5633 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:15.151642 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d01fc3d9-49a6-4f7e-b4c6-6714737a5633 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048841 May 10 14:06:15.152443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 422/866] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:06:15 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:06:15.210059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3d233ede-cca1-45f8-82da-3bbcabba1a97 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:15.210574 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3d233ede-cca1-45f8-82da-3bbcabba1a97 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:15.216254 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d233ede-cca1-45f8-82da-3bbcabba1a97 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:15.216703 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d233ede-cca1-45f8-82da-3bbcabba1a97 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:15.217462 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d233ede-cca1-45f8-82da-3bbcabba1a97 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:15.217894 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3d233ede-cca1-45f8-82da-3bbcabba1a97 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:15.242177 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3d233ede-cca1-45f8-82da-3bbcabba1a97 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Going to try to terminate instance {{(pid=117154) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:06:15.260531 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-87149b72-8c18-48f4-a291-72c170b44479 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:15.261498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-87149b72-8c18-48f4-a291-72c170b44479 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:15.268046 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-87149b72-8c18-48f4-a291-72c170b44479 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:15.268710 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-87149b72-8c18-48f4-a291-72c170b44479 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:15.269514 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-87149b72-8c18-48f4-a291-72c170b44479 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:15.270024 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-87149b72-8c18-48f4-a291-72c170b44479 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:15.341798 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3d233ede-cca1-45f8-82da-3bbcabba1a97 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "DELETE /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 204 len: 0 microversion: 2.1 time: 0.135243 May 10 14:06:15.342370 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 445/867] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:06:15 2022] DELETE /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:06:15.350877 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cd80d413-21ce-4a2b-bc9c-c2cce29f5eaf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:15.351583 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-cd80d413-21ce-4a2b-bc9c-c2cce29f5eaf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:15.357979 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cd80d413-21ce-4a2b-bc9c-c2cce29f5eaf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:15.358442 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cd80d413-21ce-4a2b-bc9c-c2cce29f5eaf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:15.359229 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cd80d413-21ce-4a2b-bc9c-c2cce29f5eaf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:15.359745 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cd80d413-21ce-4a2b-bc9c-c2cce29f5eaf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:15.438145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-87149b72-8c18-48f4-a291-72c170b44479 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:15.447432 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-87149b72-8c18-48f4-a291-72c170b44479 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:15.449161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-87149b72-8c18-48f4-a291-72c170b44479 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:15.450496 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-87149b72-8c18-48f4-a291-72c170b44479 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.194340 May 10 14:06:15.451105 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 423/868] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:15 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:15.460958 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-929b8dd5-70e9-4bda-8d76-f1b86bb37432 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:15.461827 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-929b8dd5-70e9-4bda-8d76-f1b86bb37432 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:15.470950 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-929b8dd5-70e9-4bda-8d76-f1b86bb37432 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:15.471410 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-929b8dd5-70e9-4bda-8d76-f1b86bb37432 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:15.472224 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-929b8dd5-70e9-4bda-8d76-f1b86bb37432 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:15.472671 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-929b8dd5-70e9-4bda-8d76-f1b86bb37432 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:15.553283 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-cd80d413-21ce-4a2b-bc9c-c2cce29f5eaf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:15.567725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cd80d413-21ce-4a2b-bc9c-c2cce29f5eaf tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1671 microversion: 2.1 time: 0.220827 May 10 14:06:15.568671 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 446/869] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:15 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1671 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:15.641357 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-929b8dd5-70e9-4bda-8d76-f1b86bb37432 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:15.650323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-929b8dd5-70e9-4bda-8d76-f1b86bb37432 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1314 microversion: 2.1 time: 0.197965 May 10 14:06:15.651060 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 424/870] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:15 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:16.471196 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1f06ed6f-ed3c-44ce-aef1-2b7e824b77a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:16.471800 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1f06ed6f-ed3c-44ce-aef1-2b7e824b77a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:16.478171 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1f06ed6f-ed3c-44ce-aef1-2b7e824b77a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:16.478618 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1f06ed6f-ed3c-44ce-aef1-2b7e824b77a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:16.479375 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1f06ed6f-ed3c-44ce-aef1-2b7e824b77a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:16.479810 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1f06ed6f-ed3c-44ce-aef1-2b7e824b77a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:16.585603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4b56fb52-3691-4f60-9e6b-7a94417c4ce5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:16.586334 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4b56fb52-3691-4f60-9e6b-7a94417c4ce5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:16.592765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4b56fb52-3691-4f60-9e6b-7a94417c4ce5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:16.593315 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4b56fb52-3691-4f60-9e6b-7a94417c4ce5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:16.594100 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4b56fb52-3691-4f60-9e6b-7a94417c4ce5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:16.594542 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4b56fb52-3691-4f60-9e6b-7a94417c4ce5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:16.606708 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1f06ed6f-ed3c-44ce-aef1-2b7e824b77a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:16.615310 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1f06ed6f-ed3c-44ce-aef1-2b7e824b77a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:16.616845 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1f06ed6f-ed3c-44ce-aef1-2b7e824b77a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:16.618002 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1f06ed6f-ed3c-44ce-aef1-2b7e824b77a1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1731 microversion: 2.20 time: 0.151176 May 10 14:06:16.618568 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 447/871] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:16 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:16.667627 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-be0282dd-957e-47ad-8c10-926411448d62 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:16.668143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-be0282dd-957e-47ad-8c10-926411448d62 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:16.674541 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-be0282dd-957e-47ad-8c10-926411448d62 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:16.674994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-be0282dd-957e-47ad-8c10-926411448d62 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:16.675770 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-be0282dd-957e-47ad-8c10-926411448d62 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:16.676224 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-be0282dd-957e-47ad-8c10-926411448d62 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:16.735498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4b56fb52-3691-4f60-9e6b-7a94417c4ce5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:16.743093 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4b56fb52-3691-4f60-9e6b-7a94417c4ce5 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1671 microversion: 2.1 time: 0.161392 May 10 14:06:16.743674 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 425/872] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:16 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:06:16.809909 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-be0282dd-957e-47ad-8c10-926411448d62 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:16.817141 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-be0282dd-957e-47ad-8c10-926411448d62 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1314 microversion: 2.1 time: 0.153486 May 10 14:06:16.817712 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 448/873] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:16 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:06:17.061998 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-d064a2c1-8e69-44fa-b492-59fa7bb37710 req-080ecad6-ccce-4f15-88f1-6828943bf14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b29c8399-ee26-419a-8313-ddd62ae80996", "name": "network-vif-plugged", "status": "completed", "tag": "a0fb9723-3a5f-41a6-8899-41ae9a308684"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:17.070794 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-d064a2c1-8e69-44fa-b492-59fa7bb37710 req-080ecad6-ccce-4f15-88f1-6828943bf14e service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:17.071277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-d064a2c1-8e69-44fa-b492-59fa7bb37710 req-080ecad6-ccce-4f15-88f1-6828943bf14e service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:17.083413 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-d064a2c1-8e69-44fa-b492-59fa7bb37710 req-080ecad6-ccce-4f15-88f1-6828943bf14e service nova] Creating event network-vif-plugged:a0fb9723-3a5f-41a6-8899-41ae9a308684 for instance b29c8399-ee26-419a-8313-ddd62ae80996 on hv-cinder-84067 May 10 14:06:17.088524 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-d064a2c1-8e69-44fa-b492-59fa7bb37710 req-080ecad6-ccce-4f15-88f1-6828943bf14e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030303 May 10 14:06:17.089122 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 426/874] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:17.636361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-589003f5-233f-4a22-88d6-64a2beb503c7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:17.636938 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-589003f5-233f-4a22-88d6-64a2beb503c7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:17.643531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-589003f5-233f-4a22-88d6-64a2beb503c7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:17.643984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-589003f5-233f-4a22-88d6-64a2beb503c7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:17.644792 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-589003f5-233f-4a22-88d6-64a2beb503c7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:17.645228 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-589003f5-233f-4a22-88d6-64a2beb503c7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:17.761249 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2c94802f-9688-4cdd-94e6-bdc7caad9509 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:17.762064 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2c94802f-9688-4cdd-94e6-bdc7caad9509 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:17.768746 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2c94802f-9688-4cdd-94e6-bdc7caad9509 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:17.769273 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2c94802f-9688-4cdd-94e6-bdc7caad9509 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:17.770123 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2c94802f-9688-4cdd-94e6-bdc7caad9509 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:17.770652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2c94802f-9688-4cdd-94e6-bdc7caad9509 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:17.797242 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-589003f5-233f-4a22-88d6-64a2beb503c7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:17.805557 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-589003f5-233f-4a22-88d6-64a2beb503c7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:17.807079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-589003f5-233f-4a22-88d6-64a2beb503c7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:17.808361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-589003f5-233f-4a22-88d6-64a2beb503c7 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1718 microversion: 2.20 time: 0.176218 May 10 14:06:17.808949 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 449/875] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:06:17 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1718 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:06:17.833802 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-fe0045a1-abe3-44aa-b6a3-a995dd7ad939 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:17.834423 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-fe0045a1-abe3-44aa-b6a3-a995dd7ad939 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:17.840263 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fe0045a1-abe3-44aa-b6a3-a995dd7ad939 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:17.840721 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fe0045a1-abe3-44aa-b6a3-a995dd7ad939 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:17.841496 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fe0045a1-abe3-44aa-b6a3-a995dd7ad939 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:17.841936 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-fe0045a1-abe3-44aa-b6a3-a995dd7ad939 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:17.971611 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-fe0045a1-abe3-44aa-b6a3-a995dd7ad939 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:17.978864 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-fe0045a1-abe3-44aa-b6a3-a995dd7ad939 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1314 microversion: 2.1 time: 0.148933 May 10 14:06:17.979439 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 450/876] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:17 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:06:18.011688 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2c94802f-9688-4cdd-94e6-bdc7caad9509 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:18.019362 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2c94802f-9688-4cdd-94e6-bdc7caad9509 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1671 microversion: 2.1 time: 0.262570 May 10 14:06:18.020037 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 427/877] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:17 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1671 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:06:18.790338 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-b54a85fa-84df-4d69-bcd4-3fcb589d2a8e req-7a77a7a6-baba-4c7d-9e3d-897e44c0bbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e15393-bc14-4433-b2aa-6d8fb202b9ea", "name": "network-vif-deleted", "tag": "4bee32e6-d54c-4a5f-8e31-b4e7945065bc"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:18.799538 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-b54a85fa-84df-4d69-bcd4-3fcb589d2a8e req-7a77a7a6-baba-4c7d-9e3d-897e44c0bbb6 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:18.799989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-b54a85fa-84df-4d69-bcd4-3fcb589d2a8e req-7a77a7a6-baba-4c7d-9e3d-897e44c0bbb6 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:18.823546 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-b54a85fa-84df-4d69-bcd4-3fcb589d2a8e req-7a77a7a6-baba-4c7d-9e3d-897e44c0bbb6 service nova] Creating event network-vif-deleted:4bee32e6-d54c-4a5f-8e31-b4e7945065bc for instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea on hv-cinder-84067 May 10 14:06:18.829229 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-b54a85fa-84df-4d69-bcd4-3fcb589d2a8e req-7a77a7a6-baba-4c7d-9e3d-897e44c0bbb6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042448 May 10 14:06:18.829858 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 451/878] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:18.998359 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c3eec48a-13d9-4636-81ce-b8fbff1e4410 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:18.998982 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c3eec48a-13d9-4636-81ce-b8fbff1e4410 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:19.005156 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c3eec48a-13d9-4636-81ce-b8fbff1e4410 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:19.005628 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c3eec48a-13d9-4636-81ce-b8fbff1e4410 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:19.006439 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c3eec48a-13d9-4636-81ce-b8fbff1e4410 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:19.006880 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c3eec48a-13d9-4636-81ce-b8fbff1e4410 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:19.037972 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-03396bec-1691-4221-b37b-4f84ec13fb10 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:19.038687 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-03396bec-1691-4221-b37b-4f84ec13fb10 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:19.045323 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-03396bec-1691-4221-b37b-4f84ec13fb10 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:19.045787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-03396bec-1691-4221-b37b-4f84ec13fb10 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:19.046576 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-03396bec-1691-4221-b37b-4f84ec13fb10 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:19.047023 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-03396bec-1691-4221-b37b-4f84ec13fb10 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:19.110778 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-03396bec-1691-4221-b37b-4f84ec13fb10 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:19.118174 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-03396bec-1691-4221-b37b-4f84ec13fb10 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1604 microversion: 2.1 time: 0.085151 May 10 14:06:19.119123 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 452/879] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:19 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1604 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:19.145769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c3eec48a-13d9-4636-81ce-b8fbff1e4410 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:19.153125 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c3eec48a-13d9-4636-81ce-b8fbff1e4410 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1497 microversion: 2.1 time: 0.159472 May 10 14:06:19.153706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 428/880] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:18 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:19.659400 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-852b2bf0-0a5c-4300-8a6c-9ca816fe965e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:19.659834 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-852b2bf0-0a5c-4300-8a6c-9ca816fe965e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:19.665916 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-852b2bf0-0a5c-4300-8a6c-9ca816fe965e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:19.666369 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-852b2bf0-0a5c-4300-8a6c-9ca816fe965e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:19.667148 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-852b2bf0-0a5c-4300-8a6c-9ca816fe965e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:19.667586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-852b2bf0-0a5c-4300-8a6c-9ca816fe965e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:19.695601 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-852b2bf0-0a5c-4300-8a6c-9ca816fe965e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Going to try to terminate instance {{(pid=117154) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:06:19.775751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-852b2bf0-0a5c-4300-8a6c-9ca816fe965e tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 204 len: 0 microversion: 2.1 time: 0.119967 May 10 14:06:19.776417 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 453/881] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:06:19 2022] DELETE /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:06:19.785512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d3aa5612-b77d-4365-b89d-17139e42787c tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:19.786127 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d3aa5612-b77d-4365-b89d-17139e42787c tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:19.792442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d3aa5612-b77d-4365-b89d-17139e42787c tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:19.792872 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d3aa5612-b77d-4365-b89d-17139e42787c tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:19.793732 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d3aa5612-b77d-4365-b89d-17139e42787c tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:19.794176 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d3aa5612-b77d-4365-b89d-17139e42787c tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:19.929959 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-d3aa5612-b77d-4365-b89d-17139e42787c tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:19.937511 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d3aa5612-b77d-4365-b89d-17139e42787c tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1503 microversion: 2.1 time: 0.156631 May 10 14:06:19.938089 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 429/882] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:19 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:06:20.135428 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-41895034-0b35-47e2-af89-b39a5890cc9c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:20.136133 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-41895034-0b35-47e2-af89-b39a5890cc9c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:20.143247 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41895034-0b35-47e2-af89-b39a5890cc9c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:20.143721 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41895034-0b35-47e2-af89-b39a5890cc9c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:20.144516 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41895034-0b35-47e2-af89-b39a5890cc9c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:20.144956 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41895034-0b35-47e2-af89-b39a5890cc9c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:20.174407 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41895034-0b35-47e2-af89-b39a5890cc9c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:20.174791 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-41895034-0b35-47e2-af89-b39a5890cc9c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:20.175237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-41895034-0b35-47e2-af89-b39a5890cc9c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lazy-loading 'fault' on Instance uuid 64e15393-bc14-4433-b2aa-6d8fb202b9ea {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:06:20.215868 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-41895034-0b35-47e2-af89-b39a5890cc9c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:20.223381 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-41895034-0b35-47e2-af89-b39a5890cc9c tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1326 microversion: 2.1 time: 0.092222 May 10 14:06:20.223980 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 454/883] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:20 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:20.954815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-945c542e-1d1d-46b1-8a8b-f76ca92dc4a3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:20.955431 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-945c542e-1d1d-46b1-8a8b-f76ca92dc4a3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:20.961854 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-945c542e-1d1d-46b1-8a8b-f76ca92dc4a3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:20.962309 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-945c542e-1d1d-46b1-8a8b-f76ca92dc4a3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:20.963077 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-945c542e-1d1d-46b1-8a8b-f76ca92dc4a3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:20.963515 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-945c542e-1d1d-46b1-8a8b-f76ca92dc4a3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:21.104388 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-945c542e-1d1d-46b1-8a8b-f76ca92dc4a3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:21.112275 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-945c542e-1d1d-46b1-8a8b-f76ca92dc4a3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1503 microversion: 2.1 time: 0.161352 May 10 14:06:21.112845 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 430/884] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:20 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:21.240328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d89ab77d-6f34-47a3-b997-e2fb95b8c455 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:21.241022 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d89ab77d-6f34-47a3-b997-e2fb95b8c455 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:21.247287 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d89ab77d-6f34-47a3-b997-e2fb95b8c455 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:21.247740 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d89ab77d-6f34-47a3-b997-e2fb95b8c455 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:21.248544 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d89ab77d-6f34-47a3-b997-e2fb95b8c455 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:21.248987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d89ab77d-6f34-47a3-b997-e2fb95b8c455 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:21.279027 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d89ab77d-6f34-47a3-b997-e2fb95b8c455 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:21.279481 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d89ab77d-6f34-47a3-b997-e2fb95b8c455 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:21.279933 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-d89ab77d-6f34-47a3-b997-e2fb95b8c455 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lazy-loading 'fault' on Instance uuid 64e15393-bc14-4433-b2aa-6d8fb202b9ea {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:06:21.322944 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d89ab77d-6f34-47a3-b997-e2fb95b8c455 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def10f42c8744e1d8526087c874ceedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ea52173a04c8e8624b91ac0e3eb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:21.330797 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d89ab77d-6f34-47a3-b997-e2fb95b8c455 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 200 len: 1326 microversion: 2.1 time: 0.094392 May 10 14:06:21.331377 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 455/885] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:21 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 1326 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:22.130579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-dcc5a6e2-cebf-435a-9df3-234c1f879f7b tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:22.131371 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-dcc5a6e2-cebf-435a-9df3-234c1f879f7b tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:22.137370 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dcc5a6e2-cebf-435a-9df3-234c1f879f7b tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:22.137813 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dcc5a6e2-cebf-435a-9df3-234c1f879f7b tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:22.138580 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dcc5a6e2-cebf-435a-9df3-234c1f879f7b tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:22.139017 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-dcc5a6e2-cebf-435a-9df3-234c1f879f7b tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:22.341657 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-dcc5a6e2-cebf-435a-9df3-234c1f879f7b tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:22.348406 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f9d8872f-a86e-44e2-84e5-8d4c2bc31ba8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:22.349205 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f9d8872f-a86e-44e2-84e5-8d4c2bc31ba8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:22.349950 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-dcc5a6e2-cebf-435a-9df3-234c1f879f7b tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 200 len: 1503 microversion: 2.1 time: 0.224181 May 10 14:06:22.350530 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 431/886] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:22 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:22.357454 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f9d8872f-a86e-44e2-84e5-8d4c2bc31ba8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:22.357910 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f9d8872f-a86e-44e2-84e5-8d4c2bc31ba8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:22.358693 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f9d8872f-a86e-44e2-84e5-8d4c2bc31ba8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:22.359136 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f9d8872f-a86e-44e2-84e5-8d4c2bc31ba8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:22.374107 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-f9d8872f-a86e-44e2-84e5-8d4c2bc31ba8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] HTTP exception thrown: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f9d8872f-a86e-44e2-84e5-8d4c2bc31ba8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Request method failure captured: May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea HTTP/1.1 May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_mmufc0OWqFF7O8mzSBXxYHB8G0788yc_O8qZYvyXLGjheC8B270Zpl2fVrw-x1mj5axEs8z0VrCuNg-N9k4yYnKpJlNpsfdUuaoLQObtF3ICzUwRSdOh4xzcRuUhgd_lWt98GcivmpLjJFQl3oaXxD3ufZuoROtwFQwx231em1QM May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: d19ea52173a04c8e8624b91ac0e3eb48 May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:06:22.375768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:06:22.377387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:22.377387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:22.377387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: d19ea52173a04c8e8624b91ac0e3eb48 May 10 14:06:22.377387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:22.377387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeTestJSON-1851863849-project May 10 14:06:22.377387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:06:22.377387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:06:22.377387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: def10f42c8744e1d8526087c874ceedd May 10 14:06:22.377387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeTestJSON-1851863849-project May 10 14:06:22.377387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:06:22.377387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:22.377387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '64e15393-bc14-4433-b2aa-6d8fb202b9ea'} May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:22.382392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:22.384459 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:22.387014 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f9d8872f-a86e-44e2-84e5-8d4c2bc31ba8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Returning 404 to user: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:22.387014 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f9d8872f-a86e-44e2-84e5-8d4c2bc31ba8 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 404 len: 111 microversion: 2.1 time: 0.033727 May 10 14:06:22.387014 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 456/887] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:22 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:22.387284 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f271081c-b73f-4787-add2-0f16500f9171 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '.version_select at 0x7f5f76ff6790>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:22.404789 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f271081c-b73f-4787-add2-0f16500f9171 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-228695749" status: 202 len: 0 microversion: 2.1 time: 0.021781 May 10 14:06:22.408535 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 432/888] 10.222.0.49 () {58 vars in 1217 bytes} [Tue May 10 14:06:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-228695749 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:06:22.515533 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-54b98c1b-01b4-4570-bd42-d5e68d90e7e8 req-38e2dbdb-0445-4a86-9a20-4ed3388ee340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b29c8399-ee26-419a-8313-ddd62ae80996", "name": "network-vif-deleted", "tag": "a0fb9723-3a5f-41a6-8899-41ae9a308684"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:22.525864 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-54b98c1b-01b4-4570-bd42-d5e68d90e7e8 req-38e2dbdb-0445-4a86-9a20-4ed3388ee340 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:22.526454 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-54b98c1b-01b4-4570-bd42-d5e68d90e7e8 req-38e2dbdb-0445-4a86-9a20-4ed3388ee340 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:22.540472 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-54b98c1b-01b4-4570-bd42-d5e68d90e7e8 req-38e2dbdb-0445-4a86-9a20-4ed3388ee340 service nova] Creating event network-vif-deleted:a0fb9723-3a5f-41a6-8899-41ae9a308684 for instance b29c8399-ee26-419a-8313-ddd62ae80996 on hv-cinder-84067 May 10 14:06:22.546215 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-54b98c1b-01b4-4570-bd42-d5e68d90e7e8 req-38e2dbdb-0445-4a86-9a20-4ed3388ee340 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034540 May 10 14:06:22.546815 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 457/889] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:22.920698 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2f78f11b-c792-4f33-9155-2a4fb35e6ede tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:22.921284 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2f78f11b-c792-4f33-9155-2a4fb35e6ede tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:22.927366 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2f78f11b-c792-4f33-9155-2a4fb35e6ede tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:22.927901 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2f78f11b-c792-4f33-9155-2a4fb35e6ede tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:22.928889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2f78f11b-c792-4f33-9155-2a4fb35e6ede tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:22.929402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2f78f11b-c792-4f33-9155-2a4fb35e6ede tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:23.013766 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-2f78f11b-c792-4f33-9155-2a4fb35e6ede tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lazy-loading 'services' on Instance uuid ad3b777f-9d47-4753-8fc8-27e7fabae486 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:06:23.100073 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2f78f11b-c792-4f33-9155-2a4fb35e6ede tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486/os-volume_attachments/37a980da-345a-4408-a4e6-f147bed343ad" status: 202 len: 0 microversion: 2.1 time: 0.183473 May 10 14:06:23.104571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 433/890] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 14:06:22 2022] DELETE /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486/os-volume_attachments/37a980da-345a-4408-a4e6-f147bed343ad => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:06:23.110709 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-460a64bb-15e9-4cc8-b23b-93cf97cd3624 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:23.111975 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-460a64bb-15e9-4cc8-b23b-93cf97cd3624 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:23.118660 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-460a64bb-15e9-4cc8-b23b-93cf97cd3624 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:23.119415 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-460a64bb-15e9-4cc8-b23b-93cf97cd3624 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:23.120660 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-460a64bb-15e9-4cc8-b23b-93cf97cd3624 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:23.121292 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-460a64bb-15e9-4cc8-b23b-93cf97cd3624 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:23.157826 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-460a64bb-15e9-4cc8-b23b-93cf97cd3624 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051823 May 10 14:06:23.162504 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 458/891] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:06:23 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:23.368006 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6a42e96e-ca8b-471a-b20c-11e5c47513f3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:23.368745 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-6a42e96e-ca8b-471a-b20c-11e5c47513f3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b29c8399-ee26-419a-8313-ddd62ae80996] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:23.374772 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6a42e96e-ca8b-471a-b20c-11e5c47513f3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:23.375227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6a42e96e-ca8b-471a-b20c-11e5c47513f3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:23.376546 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6a42e96e-ca8b-471a-b20c-11e5c47513f3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:23.376993 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6a42e96e-ca8b-471a-b20c-11e5c47513f3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:23.390571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-6a42e96e-ca8b-471a-b20c-11e5c47513f3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] HTTP exception thrown: Instance b29c8399-ee26-419a-8313-ddd62ae80996 could not be found. May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6a42e96e-ca8b-471a-b20c-11e5c47513f3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Request method failure captured: May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 HTTP/1.1 May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABienFMUtUVvAKXSXgJsyM3V_cabnEuZKG8AE4Smo5Ug5Ns_VBc8ryfoLBjOEzilYsGJK7qndJMwQEofrsdLW4WW_8h2WNFaUJutYXsWPxQBnKknIdCgT4eT3NhC5XGmZosQvvLNHjsUpf2QpEiwhnIsXuc4YYKY6M3nEo8mBbQftYl4Z4 May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 7a263551cedd420db2fb5b24a60835b8 May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-VolumesActionsTest-1150416183 May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:06:23.393141 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:06:23.394784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7a263551cedd420db2fb5b24a60835b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7a263551cedd420db2fb5b24a60835b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7a263551cedd420db2fb5b24a60835b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7a263551cedd420db2fb5b24a60835b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:23.394784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-VolumesActionsTest-1150416183 May 10 14:06:23.394784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 7a263551cedd420db2fb5b24a60835b8 May 10 14:06:23.394784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-VolumesActionsTest-1150416183 May 10 14:06:23.394784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-VolumesActionsTest-1150416183-project May 10 14:06:23.394784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:06:23.394784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:06:23.394784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 2ff9c506880e45bd87a16af67e107eec May 10 14:06:23.394784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-VolumesActionsTest-1150416183-project May 10 14:06:23.394784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:06:23.394784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance b29c8399-ee26-419a-8313-ddd62ae80996 could not be found. May 10 14:06:23.394784 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': 'b29c8399-ee26-419a-8313-ddd62ae80996'} May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b29c8399-ee26-419a-8313-ddd62ae80996 could not be found. May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:23.395711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b29c8399-ee26-419a-8313-ddd62ae80996 could not be found. May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b29c8399-ee26-419a-8313-ddd62ae80996 could not be found. May 10 14:06:23.397203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:23.398434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6a42e96e-ca8b-471a-b20c-11e5c47513f3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Returning 404 to user: Instance b29c8399-ee26-419a-8313-ddd62ae80996 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:23.398434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6a42e96e-ca8b-471a-b20c-11e5c47513f3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996" status: 404 len: 111 microversion: 2.1 time: 0.031169 May 10 14:06:23.398434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 434/892] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:23 2022] GET /compute/v2.1/servers/b29c8399-ee26-419a-8313-ddd62ae80996 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:23.443280 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-696233488", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "networks": [{"uuid": "b4c49f8d-1bc6-48e0-93de-59cbffeeeacc"}]}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:23.495701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] validate_networks() for [('b4c49f8d-1bc6-48e0-93de-59cbffeeeacc', None, None, None, None, None)] {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:06:23.840090 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:06:23.840554 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:06:23.841030 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:06:23.841439 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:06:23.841852 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:06:23.850471 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:23.850917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:23.851746 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:23.852198 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:23.868671 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Getting quotas for project 7a263551cedd420db2fb5b24a60835b8. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:06:23.872614 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Getting quotas for user 2ff9c506880e45bd87a16af67e107eec and project 7a263551cedd420db2fb5b24a60835b8. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:06:23.883550 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:06:23.885891 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:06:23.930808 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-47e710ec-7570-4c96-ad5a-cc9c876f7032 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491256 May 10 14:06:23.931466 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 459/893] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:06:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:06:23.941757 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2c3dae4a-77cb-4de6-8d4d-91cf7f2b9e74 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:23.942374 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2c3dae4a-77cb-4de6-8d4d-91cf7f2b9e74 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:23.995649 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2c3dae4a-77cb-4de6-8d4d-91cf7f2b9e74 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:24.002635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2c3dae4a-77cb-4de6-8d4d-91cf7f2b9e74 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1213 microversion: 2.1 time: 0.065207 May 10 14:06:24.003198 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 435/894] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:23 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:06:24.169851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7c415807-6730-40e9-9944-ea3886333f11 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:24.170835 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7c415807-6730-40e9-9944-ea3886333f11 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:24.177245 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7c415807-6730-40e9-9944-ea3886333f11 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:24.177693 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7c415807-6730-40e9-9944-ea3886333f11 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:24.178460 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7c415807-6730-40e9-9944-ea3886333f11 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:24.178897 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7c415807-6730-40e9-9944-ea3886333f11 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:24.211090 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7c415807-6730-40e9-9944-ea3886333f11 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045136 May 10 14:06:24.211754 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 460/895] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 14:06:24 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:06:24.271407 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-13817811-d07d-4031-abb0-2b21814a678d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:24.272752 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-13817811-d07d-4031-abb0-2b21814a678d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:24.280115 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-13817811-d07d-4031-abb0-2b21814a678d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:24.280603 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-13817811-d07d-4031-abb0-2b21814a678d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:24.281568 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-13817811-d07d-4031-abb0-2b21814a678d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:24.282187 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-13817811-d07d-4031-abb0-2b21814a678d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:24.308728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-13817811-d07d-4031-abb0-2b21814a678d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Going to try to terminate instance {{(pid=117153) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:06:24.389058 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-13817811-d07d-4031-abb0-2b21814a678d tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 204 len: 0 microversion: 2.1 time: 0.121424 May 10 14:06:24.393574 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 436/896] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:06:24 2022] DELETE /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:06:24.399257 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ddd9e354-e290-4784-b3ca-8c09afde2ead tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:24.399889 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ddd9e354-e290-4784-b3ca-8c09afde2ead tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:24.405713 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ddd9e354-e290-4784-b3ca-8c09afde2ead tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:24.406167 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ddd9e354-e290-4784-b3ca-8c09afde2ead tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:24.406946 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ddd9e354-e290-4784-b3ca-8c09afde2ead tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:24.407392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ddd9e354-e290-4784-b3ca-8c09afde2ead tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:24.538538 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ddd9e354-e290-4784-b3ca-8c09afde2ead tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:24.546069 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ddd9e354-e290-4784-b3ca-8c09afde2ead tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1681 microversion: 2.1 time: 0.150818 May 10 14:06:24.546650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 461/897] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:24 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:25.020078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-baeb0f59-fafa-49c7-9317-af3d930c42d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:25.021271 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-baeb0f59-fafa-49c7-9317-af3d930c42d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:25.028516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-baeb0f59-fafa-49c7-9317-af3d930c42d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:25.029098 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-baeb0f59-fafa-49c7-9317-af3d930c42d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:25.030100 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-baeb0f59-fafa-49c7-9317-af3d930c42d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:25.030632 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-baeb0f59-fafa-49c7-9317-af3d930c42d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:25.096410 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-baeb0f59-fafa-49c7-9317-af3d930c42d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:25.103921 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-baeb0f59-fafa-49c7-9317-af3d930c42d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1209 microversion: 2.1 time: 0.088803 May 10 14:06:25.104534 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 437/898] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:25 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:25.369491 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-695f6ba3-9ff1-4cec-9c6b-2b0de272bffe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:25.369991 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-695f6ba3-9ff1-4cec-9c6b-2b0de272bffe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:25.376387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-695f6ba3-9ff1-4cec-9c6b-2b0de272bffe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:25.376843 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-695f6ba3-9ff1-4cec-9c6b-2b0de272bffe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:25.377620 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-695f6ba3-9ff1-4cec-9c6b-2b0de272bffe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:25.378066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-695f6ba3-9ff1-4cec-9c6b-2b0de272bffe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:25.392208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-695f6ba3-9ff1-4cec-9c6b-2b0de272bffe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] HTTP exception thrown: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-695f6ba3-9ff1-4cec-9c6b-2b0de272bffe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Request method failure captured: May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: DELETE /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea HTTP/1.1 May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_mmufc0OWqFF7O8mzSBXxYHB8G0788yc_O8qZYvyXLGjheC8B270Zpl2fVrw-x1mj5axEs8z0VrCuNg-N9k4yYnKpJlNpsfdUuaoLQObtF3ICzUwRSdOh4xzcRuUhgd_lWt98GcivmpLjJFQl3oaXxD3ufZuoROtwFQwx231em1QM May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: d19ea52173a04c8e8624b91ac0e3eb48 May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:06:25.394173 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:06:25.395761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:25.395761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:25.395761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: d19ea52173a04c8e8624b91ac0e3eb48 May 10 14:06:25.395761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:25.395761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeTestJSON-1851863849-project May 10 14:06:25.395761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:06:25.395761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:06:25.395761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: def10f42c8744e1d8526087c874ceedd May 10 14:06:25.395761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeTestJSON-1851863849-project May 10 14:06:25.395761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:06:25.395761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:25.395761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '64e15393-bc14-4433-b2aa-6d8fb202b9ea'} May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:25.396625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:25.398044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:25.399537 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-695f6ba3-9ff1-4cec-9c6b-2b0de272bffe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Returning 404 to user: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:25.399537 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-695f6ba3-9ff1-4cec-9c6b-2b0de272bffe tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "DELETE /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 404 len: 111 microversion: 2.1 time: 0.030048 May 10 14:06:25.399537 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 462/899] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:06:25 2022] DELETE /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:25.403967 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-91df18d0-3581-4401-bb13-1e84446a34da tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:25.404595 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-91df18d0-3581-4401-bb13-1e84446a34da tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: 64e15393-bc14-4433-b2aa-6d8fb202b9ea] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:25.410899 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-91df18d0-3581-4401-bb13-1e84446a34da tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:25.411346 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-91df18d0-3581-4401-bb13-1e84446a34da tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:25.412132 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-91df18d0-3581-4401-bb13-1e84446a34da tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:25.412589 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-91df18d0-3581-4401-bb13-1e84446a34da tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:25.431404 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-91df18d0-3581-4401-bb13-1e84446a34da tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] HTTP exception thrown: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-91df18d0-3581-4401-bb13-1e84446a34da tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Request method failure captured: May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea HTTP/1.1 May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_mmufc0OWqFF7O8mzSBXxYHB8G0788yc_O8qZYvyXLGjheC8B270Zpl2fVrw-x1mj5axEs8z0VrCuNg-N9k4yYnKpJlNpsfdUuaoLQObtF3ICzUwRSdOh4xzcRuUhgd_lWt98GcivmpLjJFQl3oaXxD3ufZuoROtwFQwx231em1QM May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: d19ea52173a04c8e8624b91ac0e3eb48 May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:06:25.433783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:06:25.435728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:25.435728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:25.435728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: d19ea52173a04c8e8624b91ac0e3eb48 May 10 14:06:25.435728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:25.435728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-AttachVolumeTestJSON-1851863849-project May 10 14:06:25.435728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:06:25.435728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:06:25.435728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: def10f42c8744e1d8526087c874ceedd May 10 14:06:25.435728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-AttachVolumeTestJSON-1851863849-project May 10 14:06:25.435728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:06:25.435728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:25.435728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '64e15393-bc14-4433-b2aa-6d8fb202b9ea'} May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:25.436776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. May 10 14:06:25.438795 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:25.440092 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-91df18d0-3581-4401-bb13-1e84446a34da tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Returning 404 to user: Instance 64e15393-bc14-4433-b2aa-6d8fb202b9ea could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:25.440092 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-91df18d0-3581-4401-bb13-1e84446a34da tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea" status: 404 len: 111 microversion: 2.1 time: 0.037333 May 10 14:06:25.440092 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 438/900] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:25 2022] GET /compute/v2.1/servers/64e15393-bc14-4433-b2aa-6d8fb202b9ea => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:25.562674 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-80666728-785e-4ed3-8a22-4f17676827ca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:25.563790 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-80666728-785e-4ed3-8a22-4f17676827ca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:25.570043 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-80666728-785e-4ed3-8a22-4f17676827ca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:25.570494 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-80666728-785e-4ed3-8a22-4f17676827ca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:25.571256 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-80666728-785e-4ed3-8a22-4f17676827ca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:25.571698 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-80666728-785e-4ed3-8a22-4f17676827ca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:25.702644 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-80666728-785e-4ed3-8a22-4f17676827ca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:25.710060 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-80666728-785e-4ed3-8a22-4f17676827ca tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1681 microversion: 2.1 time: 0.151227 May 10 14:06:25.710633 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 463/901] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:25 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:26.120942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fd405a5f-95bc-450c-9ab4-493503ff1304 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:26.121578 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fd405a5f-95bc-450c-9ab4-493503ff1304 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:26.127502 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fd405a5f-95bc-450c-9ab4-493503ff1304 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:26.127959 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fd405a5f-95bc-450c-9ab4-493503ff1304 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:26.128761 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fd405a5f-95bc-450c-9ab4-493503ff1304 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:26.129203 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fd405a5f-95bc-450c-9ab4-493503ff1304 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:26.193973 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-fd405a5f-95bc-450c-9ab4-493503ff1304 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:26.201226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fd405a5f-95bc-450c-9ab4-493503ff1304 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1265 microversion: 2.1 time: 0.084129 May 10 14:06:26.201904 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 439/902] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:26 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:26.572198 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-db99fb83-76c4-44b4-8f7c-23043c61d739 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:26.572730 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-db99fb83-76c4-44b4-8f7c-23043c61d739 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:26.578961 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-db99fb83-76c4-44b4-8f7c-23043c61d739 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:26.579630 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-db99fb83-76c4-44b4-8f7c-23043c61d739 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:26.580450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-db99fb83-76c4-44b4-8f7c-23043c61d739 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:26.580895 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-db99fb83-76c4-44b4-8f7c-23043c61d739 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:26.594318 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-db99fb83-76c4-44b4-8f7c-23043c61d739 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] HTTP exception thrown: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-db99fb83-76c4-44b4-8f7c-23043c61d739 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Request method failure captured: May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: DELETE /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 HTTP/1.1 May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_mmufc0OWqFF7O8mzSBXxYHB8G0788yc_O8qZYvyXLGjheC8B270Zpl2fVrw-x1mj5axEs8z0VrCuNg-N9k4yYnKpJlNpsfdUuaoLQObtF3ICzUwRSdOh4xzcRuUhgd_lWt98GcivmpLjJFQl3oaXxD3ufZuoROtwFQwx231em1QM May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: d19ea52173a04c8e8624b91ac0e3eb48 May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:06:26.595917 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:06:26.597333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:26.597333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:26.597333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: d19ea52173a04c8e8624b91ac0e3eb48 May 10 14:06:26.597333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:26.597333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeTestJSON-1851863849-project May 10 14:06:26.597333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:06:26.597333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:06:26.597333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: def10f42c8744e1d8526087c874ceedd May 10 14:06:26.597333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeTestJSON-1851863849-project May 10 14:06:26.597333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:06:26.597333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:06:26.597333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': 'c22e54ed-bbfa-42df-af34-67721740c4b0'} May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:26.598072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:06:26.599308 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:26.600560 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-db99fb83-76c4-44b4-8f7c-23043c61d739 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Returning 404 to user: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:26.600560 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-db99fb83-76c4-44b4-8f7c-23043c61d739 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 404 len: 111 microversion: 2.1 time: 0.029000 May 10 14:06:26.600560 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 464/903] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:06:26 2022] DELETE /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:26.606213 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5be23570-4466-4240-b14a-49f0dfdcc326 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:26.606941 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-5be23570-4466-4240-b14a-49f0dfdcc326 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] [instance: c22e54ed-bbfa-42df-af34-67721740c4b0] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:26.613917 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5be23570-4466-4240-b14a-49f0dfdcc326 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:26.614366 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5be23570-4466-4240-b14a-49f0dfdcc326 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:26.615134 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5be23570-4466-4240-b14a-49f0dfdcc326 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:26.615584 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5be23570-4466-4240-b14a-49f0dfdcc326 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:26.629417 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-5be23570-4466-4240-b14a-49f0dfdcc326 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] HTTP exception thrown: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5be23570-4466-4240-b14a-49f0dfdcc326 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Request method failure captured: May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 HTTP/1.1 May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_mmufc0OWqFF7O8mzSBXxYHB8G0788yc_O8qZYvyXLGjheC8B270Zpl2fVrw-x1mj5axEs8z0VrCuNg-N9k4yYnKpJlNpsfdUuaoLQObtF3ICzUwRSdOh4xzcRuUhgd_lWt98GcivmpLjJFQl3oaXxD3ufZuoROtwFQwx231em1QM May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: d19ea52173a04c8e8624b91ac0e3eb48 May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:06:26.630920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:06:26.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d19ea52173a04c8e8624b91ac0e3eb48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:26.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:26.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: d19ea52173a04c8e8624b91ac0e3eb48 May 10 14:06:26.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1851863849 May 10 14:06:26.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-AttachVolumeTestJSON-1851863849-project May 10 14:06:26.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:06:26.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:06:26.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: def10f42c8744e1d8526087c874ceedd May 10 14:06:26.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-AttachVolumeTestJSON-1851863849-project May 10 14:06:26.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:06:26.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:06:26.632507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': 'c22e54ed-bbfa-42df-af34-67721740c4b0'} May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:26.633369 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. May 10 14:06:26.634749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:26.636160 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5be23570-4466-4240-b14a-49f0dfdcc326 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] Returning 404 to user: Instance c22e54ed-bbfa-42df-af34-67721740c4b0 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:26.636160 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-5be23570-4466-4240-b14a-49f0dfdcc326 tempest-AttachVolumeTestJSON-1851863849 tempest-AttachVolumeTestJSON-1851863849-project] 10.222.0.49 "GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0" status: 404 len: 111 microversion: 2.1 time: 0.030008 May 10 14:06:26.636160 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 440/904] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:26 2022] GET /compute/v2.1/servers/c22e54ed-bbfa-42df-af34-67721740c4b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:26.726998 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cf1da8f9-7978-4a79-ad6c-6e18de2bae42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:26.728540 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-cf1da8f9-7978-4a79-ad6c-6e18de2bae42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:26.735624 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cf1da8f9-7978-4a79-ad6c-6e18de2bae42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:26.736202 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cf1da8f9-7978-4a79-ad6c-6e18de2bae42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:26.737351 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cf1da8f9-7978-4a79-ad6c-6e18de2bae42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:26.737790 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cf1da8f9-7978-4a79-ad6c-6e18de2bae42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:27.072318 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-cf1da8f9-7978-4a79-ad6c-6e18de2bae42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:27.080829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cf1da8f9-7978-4a79-ad6c-6e18de2bae42 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1681 microversion: 2.1 time: 0.357841 May 10 14:06:27.090967 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 465/905] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:26 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1681 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:27.218173 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0ae25135-ea05-41a3-b6e8-1a497555b12a tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:27.218874 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0ae25135-ea05-41a3-b6e8-1a497555b12a tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:27.225879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0ae25135-ea05-41a3-b6e8-1a497555b12a tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:27.226424 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0ae25135-ea05-41a3-b6e8-1a497555b12a tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:27.227465 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0ae25135-ea05-41a3-b6e8-1a497555b12a tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:27.228104 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0ae25135-ea05-41a3-b6e8-1a497555b12a tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:27.323391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0ae25135-ea05-41a3-b6e8-1a497555b12a tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:27.331525 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0ae25135-ea05-41a3-b6e8-1a497555b12a tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1271 microversion: 2.1 time: 0.117282 May 10 14:06:27.336317 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 441/906] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:27 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:27.523384 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-2a4c8655-b619-496d-b0f4-bb64e7799a18 req-e931dc12-712b-4296-b662-109b1ed31130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3b777f-9d47-4753-8fc8-27e7fabae486", "name": "network-vif-deleted", "tag": "471a17c9-6251-41d8-9d93-8ecd7da310ca"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:27.555909 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-2a4c8655-b619-496d-b0f4-bb64e7799a18 req-e931dc12-712b-4296-b662-109b1ed31130 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:27.557040 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-2a4c8655-b619-496d-b0f4-bb64e7799a18 req-e931dc12-712b-4296-b662-109b1ed31130 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:27.577922 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-2a4c8655-b619-496d-b0f4-bb64e7799a18 req-e931dc12-712b-4296-b662-109b1ed31130 service nova] Creating event network-vif-deleted:471a17c9-6251-41d8-9d93-8ecd7da310ca for instance ad3b777f-9d47-4753-8fc8-27e7fabae486 on hv-cinder-84067 May 10 14:06:27.583964 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-2a4c8655-b619-496d-b0f4-bb64e7799a18 req-e931dc12-712b-4296-b662-109b1ed31130 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064350 May 10 14:06:27.588632 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 466/907] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:28.099594 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-40b5038e-5a6c-4864-8f01-aad99f295649 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:28.100932 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-40b5038e-5a6c-4864-8f01-aad99f295649 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:28.107879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40b5038e-5a6c-4864-8f01-aad99f295649 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:28.108617 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40b5038e-5a6c-4864-8f01-aad99f295649 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:28.109567 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40b5038e-5a6c-4864-8f01-aad99f295649 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:28.110214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40b5038e-5a6c-4864-8f01-aad99f295649 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:28.147029 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40b5038e-5a6c-4864-8f01-aad99f295649 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:28.147767 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-40b5038e-5a6c-4864-8f01-aad99f295649 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:28.148261 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-40b5038e-5a6c-4864-8f01-aad99f295649 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lazy-loading 'fault' on Instance uuid ad3b777f-9d47-4753-8fc8-27e7fabae486 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:06:28.191421 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-40b5038e-5a6c-4864-8f01-aad99f295649 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c563c6a229b4e619992ccfb0da1a748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:28.200715 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-40b5038e-5a6c-4864-8f01-aad99f295649 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 200 len: 1332 microversion: 2.1 time: 0.105983 May 10 14:06:28.211418 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 442/908] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:28 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:28.352643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-00516a1f-82a3-4ac5-8781-25c9e14677ba tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:28.353563 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-00516a1f-82a3-4ac5-8781-25c9e14677ba tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:28.362121 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-00516a1f-82a3-4ac5-8781-25c9e14677ba tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:28.362856 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-00516a1f-82a3-4ac5-8781-25c9e14677ba tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:28.363667 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-00516a1f-82a3-4ac5-8781-25c9e14677ba tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:28.364114 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-00516a1f-82a3-4ac5-8781-25c9e14677ba tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:28.666242 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-00516a1f-82a3-4ac5-8781-25c9e14677ba tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:28.675653 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-00516a1f-82a3-4ac5-8781-25c9e14677ba tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1313 microversion: 2.1 time: 0.328781 May 10 14:06:28.676475 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 467/909] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:28 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:06:29.218457 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d4a47002-7641-4b25-8684-06ddf0e9a43a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:29.219147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d4a47002-7641-4b25-8684-06ddf0e9a43a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:29.225466 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d4a47002-7641-4b25-8684-06ddf0e9a43a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:29.225918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d4a47002-7641-4b25-8684-06ddf0e9a43a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:29.226702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d4a47002-7641-4b25-8684-06ddf0e9a43a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:29.227460 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d4a47002-7641-4b25-8684-06ddf0e9a43a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:29.241279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-d4a47002-7641-4b25-8684-06ddf0e9a43a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d4a47002-7641-4b25-8684-06ddf0e9a43a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 HTTP/1.1 May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:06:29.242815 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:06:29.244643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:29.244643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:29.244643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:29.244643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:29.244643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:29.244643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:06:29.244643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:06:29.244643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:06:29.244643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:29.244643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:06:29.244643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:29.244643 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': 'ad3b777f-9d47-4753-8fc8-27e7fabae486'} May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:29.245836 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:29.247277 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:29.248965 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d4a47002-7641-4b25-8684-06ddf0e9a43a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 404 to user: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:29.248965 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d4a47002-7641-4b25-8684-06ddf0e9a43a tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 404 len: 111 microversion: 2.1 time: 0.029655 May 10 14:06:29.248965 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 443/910] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:29 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:29.253939 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f73df47f-1fee-461d-bb2c-06fa49ef2688 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '.version_select at 0x7f5f7c0a44c0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:29.275471 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f73df47f-1fee-461d-bb2c-06fa49ef2688 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1277131625" status: 202 len: 0 microversion: 2.1 time: 0.026037 May 10 14:06:29.279410 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 468/911] 10.222.0.49 () {58 vars in 1220 bytes} [Tue May 10 14:06:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1277131625 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:06:29.541853 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-9e8a1f0c-8f03-4cd2-9321-d4e64064fe88 req-63616387-c697-4218-a9d3-b066da36e5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f9e236-1f12-4d97-8e69-ab2a7f5588a6", "tag": "cad9fde6-c40a-4571-b45a-2bbd8ea1f8b4"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:29.566115 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-9e8a1f0c-8f03-4cd2-9321-d4e64064fe88 req-63616387-c697-4218-a9d3-b066da36e5e4 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:29.570163 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-9e8a1f0c-8f03-4cd2-9321-d4e64064fe88 req-63616387-c697-4218-a9d3-b066da36e5e4 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:29.597417 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-9e8a1f0c-8f03-4cd2-9321-d4e64064fe88 req-63616387-c697-4218-a9d3-b066da36e5e4 service nova] Creating event network-changed:cad9fde6-c40a-4571-b45a-2bbd8ea1f8b4 for instance b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 on hv-cinder-84067 May 10 14:06:29.602633 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-9e8a1f0c-8f03-4cd2-9321-d4e64064fe88 req-63616387-c697-4218-a9d3-b066da36e5e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064453 May 10 14:06:29.604504 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 444/912] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:29.696667 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-85d2887d-95a7-42ea-91f7-8c9a630680f9 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:29.698760 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-85d2887d-95a7-42ea-91f7-8c9a630680f9 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:29.706599 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-85d2887d-95a7-42ea-91f7-8c9a630680f9 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:29.707733 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-85d2887d-95a7-42ea-91f7-8c9a630680f9 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:29.709582 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-85d2887d-95a7-42ea-91f7-8c9a630680f9 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:29.710381 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-85d2887d-95a7-42ea-91f7-8c9a630680f9 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:30.123904 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-85d2887d-95a7-42ea-91f7-8c9a630680f9 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:30.132523 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-85d2887d-95a7-42ea-91f7-8c9a630680f9 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1313 microversion: 2.1 time: 0.441919 May 10 14:06:30.133387 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 469/913] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:29 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:31.130635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e2f79923-6844-4809-9b7b-8762d5e7750e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:31.131680 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e2f79923-6844-4809-9b7b-8762d5e7750e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:31.139491 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2f79923-6844-4809-9b7b-8762d5e7750e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:31.140251 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2f79923-6844-4809-9b7b-8762d5e7750e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:31.141491 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2f79923-6844-4809-9b7b-8762d5e7750e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:31.142040 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e2f79923-6844-4809-9b7b-8762d5e7750e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:31.150293 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-43728eaf-d513-4cf7-bced-632382ceb549 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:31.151467 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-43728eaf-d513-4cf7-bced-632382ceb549 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:31.159036 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-e2f79923-6844-4809-9b7b-8762d5e7750e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:31.159414 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-43728eaf-d513-4cf7-bced-632382ceb549 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:31.159876 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-43728eaf-d513-4cf7-bced-632382ceb549 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:31.160703 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-43728eaf-d513-4cf7-bced-632382ceb549 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e2f79923-6844-4809-9b7b-8762d5e7750e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: DELETE /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 HTTP/1.1 May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:06:31.161015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:06:31.162604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:31.162604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:31.162604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:31.162604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:31.162604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:31.162604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:06:31.162604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:06:31.162604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:06:31.162604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:31.162604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:06:31.162604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:31.162604 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': 'ad3b777f-9d47-4753-8fc8-27e7fabae486'} May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:31.163841 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:31.165566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:31.168818 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e2f79923-6844-4809-9b7b-8762d5e7750e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 404 to user: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:31.168818 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e2f79923-6844-4809-9b7b-8762d5e7750e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 404 len: 111 microversion: 2.1 time: 0.038806 May 10 14:06:31.168818 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 445/914] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:06:31 2022] DELETE /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:31.169583 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-43728eaf-d513-4cf7-bced-632382ceb549 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:31.174577 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-26521518-f95c-46be-b95c-2488483f439e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:31.175351 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-26521518-f95c-46be-b95c-2488483f439e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: ad3b777f-9d47-4753-8fc8-27e7fabae486] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:31.181539 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-26521518-f95c-46be-b95c-2488483f439e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:31.182255 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-26521518-f95c-46be-b95c-2488483f439e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:31.183153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-26521518-f95c-46be-b95c-2488483f439e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:31.183972 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-26521518-f95c-46be-b95c-2488483f439e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:31.199345 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-26521518-f95c-46be-b95c-2488483f439e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-26521518-f95c-46be-b95c-2488483f439e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 HTTP/1.1 May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:06:31.201211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:06:31.202544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:31.202544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:31.202544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:31.202544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:31.202544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:31.202544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:06:31.202544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:06:31.202544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:06:31.202544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:31.202544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:06:31.202544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:31.202544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': 'ad3b777f-9d47-4753-8fc8-27e7fabae486'} May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:31.203267 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. May 10 14:06:31.204516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:31.205585 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-26521518-f95c-46be-b95c-2488483f439e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 404 to user: Instance ad3b777f-9d47-4753-8fc8-27e7fabae486 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:31.205585 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-26521518-f95c-46be-b95c-2488483f439e tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486" status: 404 len: 111 microversion: 2.1 time: 0.032609 May 10 14:06:31.205585 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 446/915] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:31 2022] GET /compute/v2.1/servers/ad3b777f-9d47-4753-8fc8-27e7fabae486 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:31.525638 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-43728eaf-d513-4cf7-bced-632382ceb549 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:31.535123 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-43728eaf-d513-4cf7-bced-632382ceb549 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1313 microversion: 2.1 time: 0.388550 May 10 14:06:31.536079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 470/916] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:31 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:06:32.342647 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-688e6489-1565-4ee3-a621-0d8ca6057594 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:32.343147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-688e6489-1565-4ee3-a621-0d8ca6057594 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:32.349797 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-688e6489-1565-4ee3-a621-0d8ca6057594 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:32.350527 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-688e6489-1565-4ee3-a621-0d8ca6057594 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:32.351509 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-688e6489-1565-4ee3-a621-0d8ca6057594 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:32.352132 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-688e6489-1565-4ee3-a621-0d8ca6057594 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:32.365880 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-688e6489-1565-4ee3-a621-0d8ca6057594 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-688e6489-1565-4ee3-a621-0d8ca6057594 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: DELETE /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 HTTP/1.1 May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:06:32.367442 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:06:32.369066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:32.369066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:32.369066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:32.369066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:32.369066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:32.369066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:06:32.369066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:06:32.369066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:06:32.369066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:32.369066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:06:32.369066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:06:32.369066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '61ade9bf-f1d4-454c-928b-bb882c680d30'} May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:32.369889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:06:32.371094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:32.372724 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-688e6489-1565-4ee3-a621-0d8ca6057594 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 404 to user: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:32.372724 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-688e6489-1565-4ee3-a621-0d8ca6057594 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 404 len: 111 microversion: 2.1 time: 0.030174 May 10 14:06:32.372724 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 447/917] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:06:32 2022] DELETE /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:06:32.378396 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8bc47f33-d660-4a92-b55f-dbb4341bc4a1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:32.379289 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8bc47f33-d660-4a92-b55f-dbb4341bc4a1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 61ade9bf-f1d4-454c-928b-bb882c680d30] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:32.387819 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8bc47f33-d660-4a92-b55f-dbb4341bc4a1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:32.388314 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8bc47f33-d660-4a92-b55f-dbb4341bc4a1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:32.389090 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8bc47f33-d660-4a92-b55f-dbb4341bc4a1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:32.389684 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8bc47f33-d660-4a92-b55f-dbb4341bc4a1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:32.404503 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-8bc47f33-d660-4a92-b55f-dbb4341bc4a1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8bc47f33-d660-4a92-b55f-dbb4341bc4a1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 HTTP/1.1 May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:06:32.406195 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:06:32.407779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:32.407779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:32.407779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:32.407779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:32.407779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:32.407779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:06:32.407779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:06:32.407779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:06:32.407779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:32.407779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:06:32.407779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:06:32.407779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '61ade9bf-f1d4-454c-928b-bb882c680d30'} May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:32.408643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. May 10 14:06:32.409816 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:32.410878 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8bc47f33-d660-4a92-b55f-dbb4341bc4a1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 404 to user: Instance 61ade9bf-f1d4-454c-928b-bb882c680d30 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:32.410878 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8bc47f33-d660-4a92-b55f-dbb4341bc4a1 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30" status: 404 len: 111 microversion: 2.1 time: 0.033645 May 10 14:06:32.410878 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 471/918] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:32 2022] GET /compute/v2.1/servers/61ade9bf-f1d4-454c-928b-bb882c680d30 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:06:32.416699 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e759c404-4451-4d62-8e51-59db28807079 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:32.417336 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e759c404-4451-4d62-8e51-59db28807079 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:32.423605 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e759c404-4451-4d62-8e51-59db28807079 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:32.424054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e759c404-4451-4d62-8e51-59db28807079 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:32.424846 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e759c404-4451-4d62-8e51-59db28807079 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:32.425283 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e759c404-4451-4d62-8e51-59db28807079 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:32.440593 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-e759c404-4451-4d62-8e51-59db28807079 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e759c404-4451-4d62-8e51-59db28807079 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: DELETE /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 HTTP/1.1 May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:06:32.442114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:06:32.443485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:32.443485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:32.443485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:32.443485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:32.443485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:32.443485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:06:32.443485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:06:32.443485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:06:32.443485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:32.443485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:06:32.443485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:06:32.443485 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '4fa06f26-fa96-4753-9ea2-c2abecdb7087'} May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:32.444290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:06:32.445636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:32.446926 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e759c404-4451-4d62-8e51-59db28807079 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 404 to user: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:32.446926 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e759c404-4451-4d62-8e51-59db28807079 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 404 len: 111 microversion: 2.1 time: 0.031248 May 10 14:06:32.446926 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 448/919] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:06:32 2022] DELETE /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:32.453140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7a64f9d6-3679-473e-8188-c37602003bd2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:32.453941 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7a64f9d6-3679-473e-8188-c37602003bd2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 4fa06f26-fa96-4753-9ea2-c2abecdb7087] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:32.461198 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7a64f9d6-3679-473e-8188-c37602003bd2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:32.461864 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7a64f9d6-3679-473e-8188-c37602003bd2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:32.462650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7a64f9d6-3679-473e-8188-c37602003bd2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:32.463095 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7a64f9d6-3679-473e-8188-c37602003bd2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:32.477319 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-7a64f9d6-3679-473e-8188-c37602003bd2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7a64f9d6-3679-473e-8188-c37602003bd2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 HTTP/1.1 May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:06:32.478899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:06:32.480328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:32.480328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:32.480328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:32.480328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:32.480328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:32.480328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:06:32.480328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:06:32.480328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:06:32.480328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:32.480328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:06:32.480328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:06:32.480328 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '4fa06f26-fa96-4753-9ea2-c2abecdb7087'} May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:32.481758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. May 10 14:06:32.483640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:32.485561 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7a64f9d6-3679-473e-8188-c37602003bd2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 404 to user: Instance 4fa06f26-fa96-4753-9ea2-c2abecdb7087 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:32.485561 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7a64f9d6-3679-473e-8188-c37602003bd2 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087" status: 404 len: 111 microversion: 2.1 time: 0.031062 May 10 14:06:32.485561 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 472/920] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:32 2022] GET /compute/v2.1/servers/4fa06f26-fa96-4753-9ea2-c2abecdb7087 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:32.552306 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b9c638ab-b165-4107-9507-7fa7f8614e68 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:32.552916 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b9c638ab-b165-4107-9507-7fa7f8614e68 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:32.558728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b9c638ab-b165-4107-9507-7fa7f8614e68 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:32.559175 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b9c638ab-b165-4107-9507-7fa7f8614e68 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:32.559947 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b9c638ab-b165-4107-9507-7fa7f8614e68 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:32.560420 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b9c638ab-b165-4107-9507-7fa7f8614e68 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:32.699114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-b9c638ab-b165-4107-9507-7fa7f8614e68 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:32.706533 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b9c638ab-b165-4107-9507-7fa7f8614e68 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1313 microversion: 2.1 time: 0.158024 May 10 14:06:32.707182 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 449/921] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:32 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:33.615667 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2772b207-cb20-4f0b-a8d6-8103a52a5f71 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:33.616855 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2772b207-cb20-4f0b-a8d6-8103a52a5f71 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:33.624564 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2772b207-cb20-4f0b-a8d6-8103a52a5f71 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:33.625836 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2772b207-cb20-4f0b-a8d6-8103a52a5f71 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:33.626846 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2772b207-cb20-4f0b-a8d6-8103a52a5f71 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:33.627528 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2772b207-cb20-4f0b-a8d6-8103a52a5f71 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:33.645140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-2772b207-cb20-4f0b-a8d6-8103a52a5f71 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2772b207-cb20-4f0b-a8d6-8103a52a5f71 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: DELETE /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 HTTP/1.1 May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:06:33.646727 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:06:33.648078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:33.648078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:33.648078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:33.648078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:33.648078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:33.648078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:06:33.648078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:06:33.648078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:06:33.648078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:33.648078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:06:33.648078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:06:33.648078 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '1e5f6640-8318-4ba7-be1f-7a578b595363'} May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:33.648994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:06:33.650419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:33.651864 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2772b207-cb20-4f0b-a8d6-8103a52a5f71 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 404 to user: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:33.656868 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2772b207-cb20-4f0b-a8d6-8103a52a5f71 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 404 len: 111 microversion: 2.1 time: 0.044905 May 10 14:06:33.657454 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 473/922] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:06:33 2022] DELETE /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:33.665483 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-96e50d33-ca17-4796-944f-44d06ba29b72 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:33.666100 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-96e50d33-ca17-4796-944f-44d06ba29b72 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] [instance: 1e5f6640-8318-4ba7-be1f-7a578b595363] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:33.673450 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-96e50d33-ca17-4796-944f-44d06ba29b72 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:33.673901 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-96e50d33-ca17-4796-944f-44d06ba29b72 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:33.674688 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-96e50d33-ca17-4796-944f-44d06ba29b72 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:33.675128 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-96e50d33-ca17-4796-944f-44d06ba29b72 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:33.689565 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-96e50d33-ca17-4796-944f-44d06ba29b72 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] HTTP exception thrown: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-96e50d33-ca17-4796-944f-44d06ba29b72 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Request method failure captured: May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 HTTP/1.1 May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_x03lTcFN3Qo4pL28DLual9m5Va9u4cL7MYFlEBTrZwM5VOxAzIqlO3ZrcOQmz4xFkSDhKA2A0E8GQuNnInz-w52---ngPQcSvZESJusqUbRmDRYqmCoZ38Ae1yVZswR7Vq9-MXBoJqk7vGILEXxWSZL33up3iErYRo71mq_zxl7Q May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:06:33.691202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:06:33.692783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e296ee60cdee4a6b9ca754c83b8c9ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:33.692783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:33.692783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: e296ee60cdee4a6b9ca754c83b8c9ffd May 10 14:06:33.692783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553144282 May 10 14:06:33.692783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:33.692783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:06:33.692783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:06:33.692783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 8c563c6a229b4e619992ccfb0da1a748 May 10 14:06:33.692783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-AttachVolumeNegativeTest-553144282-project May 10 14:06:33.692783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:06:33.692783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:06:33.692783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '1e5f6640-8318-4ba7-be1f-7a578b595363'} May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:33.693718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. May 10 14:06:33.695227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:33.696609 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-96e50d33-ca17-4796-944f-44d06ba29b72 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] Returning 404 to user: Instance 1e5f6640-8318-4ba7-be1f-7a578b595363 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:33.696609 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-96e50d33-ca17-4796-944f-44d06ba29b72 tempest-AttachVolumeNegativeTest-553144282 tempest-AttachVolumeNegativeTest-553144282-project] 10.222.0.49 "GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363" status: 404 len: 111 microversion: 2.1 time: 0.031156 May 10 14:06:33.696609 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 450/923] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:33 2022] GET /compute/v2.1/servers/1e5f6640-8318-4ba7-be1f-7a578b595363 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:33.722722 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ea8484f4-3c2e-421d-bc51-f4cfcaab7339 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:33.723340 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ea8484f4-3c2e-421d-bc51-f4cfcaab7339 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:33.729396 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ea8484f4-3c2e-421d-bc51-f4cfcaab7339 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:33.730025 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ea8484f4-3c2e-421d-bc51-f4cfcaab7339 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:33.731053 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ea8484f4-3c2e-421d-bc51-f4cfcaab7339 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:33.731761 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ea8484f4-3c2e-421d-bc51-f4cfcaab7339 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:33.886933 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ea8484f4-3c2e-421d-bc51-f4cfcaab7339 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:33.895049 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ea8484f4-3c2e-421d-bc51-f4cfcaab7339 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1313 microversion: 2.1 time: 0.176288 May 10 14:06:33.895635 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 474/924] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:33 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:34.912279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1cb28b48-e8ef-4d45-9215-e613aeedceb3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:34.912864 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1cb28b48-e8ef-4d45-9215-e613aeedceb3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:34.919114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1cb28b48-e8ef-4d45-9215-e613aeedceb3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:34.920108 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1cb28b48-e8ef-4d45-9215-e613aeedceb3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:34.921088 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1cb28b48-e8ef-4d45-9215-e613aeedceb3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:34.921527 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1cb28b48-e8ef-4d45-9215-e613aeedceb3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:35.170897 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1cb28b48-e8ef-4d45-9215-e613aeedceb3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:35.180901 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1cb28b48-e8ef-4d45-9215-e613aeedceb3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1313 microversion: 2.1 time: 0.273684 May 10 14:06:35.192825 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 451/925] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:34 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:35.235301 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-b09562ed-cbd1-4338-a7b6-d47e396a9c83 req-70f3cde1-78c2-455e-99a4-9a963cf7b38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f9e236-1f12-4d97-8e69-ab2a7f5588a6", "name": "network-vif-plugged", "status": "completed", "tag": "cad9fde6-c40a-4571-b45a-2bbd8ea1f8b4"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:35.254302 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-b09562ed-cbd1-4338-a7b6-d47e396a9c83 req-70f3cde1-78c2-455e-99a4-9a963cf7b38c service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:35.256728 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-b09562ed-cbd1-4338-a7b6-d47e396a9c83 req-70f3cde1-78c2-455e-99a4-9a963cf7b38c service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:35.287948 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-b09562ed-cbd1-4338-a7b6-d47e396a9c83 req-70f3cde1-78c2-455e-99a4-9a963cf7b38c service nova] Creating event network-vif-plugged:cad9fde6-c40a-4571-b45a-2bbd8ea1f8b4 for instance b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 on hv-cinder-84067 May 10 14:06:35.301877 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-b09562ed-cbd1-4338-a7b6-d47e396a9c83 req-70f3cde1-78c2-455e-99a4-9a963cf7b38c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074386 May 10 14:06:35.304209 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 475/926] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:06:36.200191 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-10fc3728-9dc2-4d37-bdd3-e179f357fbb6 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:36.200772 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-10fc3728-9dc2-4d37-bdd3-e179f357fbb6 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:36.211410 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-10fc3728-9dc2-4d37-bdd3-e179f357fbb6 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:36.211916 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-10fc3728-9dc2-4d37-bdd3-e179f357fbb6 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:36.213653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-10fc3728-9dc2-4d37-bdd3-e179f357fbb6 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:36.214281 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-10fc3728-9dc2-4d37-bdd3-e179f357fbb6 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:36.434086 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-10fc3728-9dc2-4d37-bdd3-e179f357fbb6 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:36.443879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-10fc3728-9dc2-4d37-bdd3-e179f357fbb6 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1313 microversion: 2.1 time: 0.248302 May 10 14:06:36.452585 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 452/927] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:36 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:37.469734 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-49f7aa6b-d22f-47f4-a2eb-c7bceac62228 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:37.471495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-49f7aa6b-d22f-47f4-a2eb-c7bceac62228 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:37.490502 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-49f7aa6b-d22f-47f4-a2eb-c7bceac62228 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:37.490861 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-49f7aa6b-d22f-47f4-a2eb-c7bceac62228 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:37.491764 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-49f7aa6b-d22f-47f4-a2eb-c7bceac62228 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:37.493510 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-49f7aa6b-d22f-47f4-a2eb-c7bceac62228 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:37.723606 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-49f7aa6b-d22f-47f4-a2eb-c7bceac62228 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:37.731954 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-49f7aa6b-d22f-47f4-a2eb-c7bceac62228 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1496 microversion: 2.1 time: 0.273911 May 10 14:06:37.732478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 476/928] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:37 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1496 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:38.286520 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7f8f634b-7cdc-48d9-a1c6-040d296868d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:38.287129 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7f8f634b-7cdc-48d9-a1c6-040d296868d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:38.294399 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7f8f634b-7cdc-48d9-a1c6-040d296868d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:38.295000 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7f8f634b-7cdc-48d9-a1c6-040d296868d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:38.295834 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7f8f634b-7cdc-48d9-a1c6-040d296868d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:38.296412 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7f8f634b-7cdc-48d9-a1c6-040d296868d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:38.322169 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7f8f634b-7cdc-48d9-a1c6-040d296868d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Going to try to terminate instance {{(pid=117153) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:06:38.416744 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7f8f634b-7cdc-48d9-a1c6-040d296868d3 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 204 len: 0 microversion: 2.1 time: 0.134260 May 10 14:06:38.417518 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 453/929] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:06:38 2022] DELETE /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 14:06:38.426403 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-781fb157-de96-46b6-806d-816e59193f52 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:38.427150 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-781fb157-de96-46b6-806d-816e59193f52 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:38.433416 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-781fb157-de96-46b6-806d-816e59193f52 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:38.433805 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-781fb157-de96-46b6-806d-816e59193f52 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:38.434575 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-781fb157-de96-46b6-806d-816e59193f52 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:38.435000 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-781fb157-de96-46b6-806d-816e59193f52 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:38.581179 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-781fb157-de96-46b6-806d-816e59193f52 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:38.590634 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-781fb157-de96-46b6-806d-816e59193f52 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1502 microversion: 2.1 time: 0.168601 May 10 14:06:38.602267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 477/930] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:38 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:38.937992 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-47584f3f-8281-4034-b4d1-67f5db12d55c tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Action: 'create', calling method: .version_select at 0x7f5f76fa2ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-848919607"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:39.212025 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-47584f3f-8281-4034-b4d1-67f5db12d55c tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.382642 May 10 14:06:39.212831 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 454/931] 10.222.0.49 () {60 vars in 1154 bytes} [Tue May 10 14:06:38 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 384 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 14:06:39.223893 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-89308485-286d-4ae9-9379-781e51af222b tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f7c083310>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:39.273038 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-89308485-286d-4ae9-9379-781e51af222b tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841" status: 200 len: 344 microversion: 2.1 time: 0.052848 May 10 14:06:39.273632 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 478/932] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:06:39 2022] GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:39.609950 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-92d87cb7-132e-4fdf-a733-3250a5a67e81 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:39.610592 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-92d87cb7-132e-4fdf-a733-3250a5a67e81 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:39.617279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-92d87cb7-132e-4fdf-a733-3250a5a67e81 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:39.617706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-92d87cb7-132e-4fdf-a733-3250a5a67e81 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:39.618461 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-92d87cb7-132e-4fdf-a733-3250a5a67e81 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:39.618893 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-92d87cb7-132e-4fdf-a733-3250a5a67e81 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:39.752473 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-92d87cb7-132e-4fdf-a733-3250a5a67e81 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:39.759927 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-92d87cb7-132e-4fdf-a733-3250a5a67e81 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1502 microversion: 2.1 time: 0.154359 May 10 14:06:39.760530 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 455/933] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:39 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:40.287048 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1741b2fa-849d-48bc-8a30-66f3ff4b72aa tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f76776ca0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:40.333485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1741b2fa-849d-48bc-8a30-66f3ff4b72aa tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841" status: 200 len: 345 microversion: 2.1 time: 0.051666 May 10 14:06:40.334188 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 479/934] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:06:40 2022] GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:40.346809 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1367fe65-9f30-4bc4-aed9-add398b1a74f tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Action: 'create', calling method: .version_select at 0x7f5f76f3edc0>, body: {"snapshot": {"volume_id": "b69b4eb0-a28a-4dec-93d1-7622f81da841", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1120854875"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:40.435345 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-381bc28e-b117-496d-b8cf-d1b9c7008fec req-c4d95868-b755-4819-86f6-b0979d65f01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f9e236-1f12-4d97-8e69-ab2a7f5588a6", "name": "network-vif-deleted", "tag": "cad9fde6-c40a-4571-b45a-2bbd8ea1f8b4"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:40.445151 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-381bc28e-b117-496d-b8cf-d1b9c7008fec req-c4d95868-b755-4819-86f6-b0979d65f01f service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:40.445527 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-381bc28e-b117-496d-b8cf-d1b9c7008fec req-c4d95868-b755-4819-86f6-b0979d65f01f service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:40.457168 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-381bc28e-b117-496d-b8cf-d1b9c7008fec req-c4d95868-b755-4819-86f6-b0979d65f01f service nova] Creating event network-vif-deleted:cad9fde6-c40a-4571-b45a-2bbd8ea1f8b4 for instance b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 on hv-cinder-84067 May 10 14:06:40.462683 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-381bc28e-b117-496d-b8cf-d1b9c7008fec req-c4d95868-b755-4819-86f6-b0979d65f01f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030820 May 10 14:06:40.463375 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 480/935] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:40.513414 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1367fe65-9f30-4bc4-aed9-add398b1a74f tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.171822 May 10 14:06:40.519315 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 456/936] 10.222.0.49 () {60 vars in 1161 bytes} [Tue May 10 14:06:40 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:40.525160 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-12bf2cbe-6779-43ad-92eb-147c78591d9b tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f76776ca0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:40.563210 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-12bf2cbe-6779-43ad-92eb-147c78591d9b tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd" status: 200 len: 287 microversion: 2.1 time: 0.040073 May 10 14:06:40.563810 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 481/937] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 14:06:40 2022] GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:06:40.573658 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e7e20e25-f32e-40c6-8603-dee1121e450d tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f76fbce50>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:40.605282 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e7e20e25-f32e-40c6-8603-dee1121e450d tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035259 May 10 14:06:40.605852 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 457/938] 10.222.0.49 () {58 vars in 1139 bytes} [Tue May 10 14:06:40 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:40.616216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-b1df27f3-1c86-43da-a42f-44e9ddb2b2e9 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f7c022b80>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:40.644319 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-b1df27f3-1c86-43da-a42f-44e9ddb2b2e9 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd" status: 200 len: 287 microversion: 2.1 time: 0.031721 May 10 14:06:40.645066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 482/939] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 14:06:40 2022] GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:40.777543 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3b3adda1-2ed3-4211-bd03-cb2c9b15c130 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:40.780662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-3b3adda1-2ed3-4211-bd03-cb2c9b15c130 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:40.787176 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3b3adda1-2ed3-4211-bd03-cb2c9b15c130 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:40.787618 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3b3adda1-2ed3-4211-bd03-cb2c9b15c130 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:40.788411 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3b3adda1-2ed3-4211-bd03-cb2c9b15c130 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:40.788850 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3b3adda1-2ed3-4211-bd03-cb2c9b15c130 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:40.817316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3b3adda1-2ed3-4211-bd03-cb2c9b15c130 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:40.817759 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3b3adda1-2ed3-4211-bd03-cb2c9b15c130 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:40.818198 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-3b3adda1-2ed3-4211-bd03-cb2c9b15c130 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lazy-loading 'fault' on Instance uuid b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:06:40.858211 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3b3adda1-2ed3-4211-bd03-cb2c9b15c130 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:40.865363 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3b3adda1-2ed3-4211-bd03-cb2c9b15c130 tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1303 microversion: 2.1 time: 0.092192 May 10 14:06:40.866042 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 458/940] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:40 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:41.656011 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-65b450a8-d4b9-4caf-b0dc-fc730c2f0edc tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f7c0831f0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:41.685192 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-65b450a8-d4b9-4caf-b0dc-fc730c2f0edc tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd" status: 200 len: 287 microversion: 2.1 time: 0.033535 May 10 14:06:41.685734 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 483/941] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 14:06:41 2022] GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:41.882900 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8621f2ca-8a71-454a-830d-c3e432aeaf8f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:41.883505 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8621f2ca-8a71-454a-830d-c3e432aeaf8f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:41.889837 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8621f2ca-8a71-454a-830d-c3e432aeaf8f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:41.890288 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8621f2ca-8a71-454a-830d-c3e432aeaf8f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:41.891048 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8621f2ca-8a71-454a-830d-c3e432aeaf8f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:41.891495 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8621f2ca-8a71-454a-830d-c3e432aeaf8f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:41.921473 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8621f2ca-8a71-454a-830d-c3e432aeaf8f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:41.921854 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8621f2ca-8a71-454a-830d-c3e432aeaf8f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:41.922297 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-8621f2ca-8a71-454a-830d-c3e432aeaf8f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lazy-loading 'fault' on Instance uuid b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:06:41.965179 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8621f2ca-8a71-454a-830d-c3e432aeaf8f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:41.972300 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8621f2ca-8a71-454a-830d-c3e432aeaf8f tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1303 microversion: 2.1 time: 0.093230 May 10 14:06:41.973056 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 459/942] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:41 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:42.697445 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d740f575-4c47-499d-a9b1-de5d37048b3d tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f767389d0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:42.725575 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d740f575-4c47-499d-a9b1-de5d37048b3d tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd" status: 200 len: 287 microversion: 2.1 time: 0.032506 May 10 14:06:42.726129 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 484/943] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 14:06:42 2022] GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:42.989199 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3a2219e2-e394-44ce-9433-b6f3b03e074d tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:42.989749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-3a2219e2-e394-44ce-9433-b6f3b03e074d tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:42.995976 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3a2219e2-e394-44ce-9433-b6f3b03e074d tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:42.996461 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3a2219e2-e394-44ce-9433-b6f3b03e074d tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:42.997226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3a2219e2-e394-44ce-9433-b6f3b03e074d tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:42.997665 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3a2219e2-e394-44ce-9433-b6f3b03e074d tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:43.027521 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3a2219e2-e394-44ce-9433-b6f3b03e074d tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:43.027970 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3a2219e2-e394-44ce-9433-b6f3b03e074d tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:43.028444 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-3a2219e2-e394-44ce-9433-b6f3b03e074d tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lazy-loading 'fault' on Instance uuid b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:06:43.068384 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-3a2219e2-e394-44ce-9433-b6f3b03e074d tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9c506880e45bd87a16af67e107eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a263551cedd420db2fb5b24a60835b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:43.075506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3a2219e2-e394-44ce-9433-b6f3b03e074d tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 200 len: 1303 microversion: 2.1 time: 0.090244 May 10 14:06:43.076075 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 460/944] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:42 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:43.738344 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e25c2f89-60b6-4704-83dd-0ded862ac6cf tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f767bfd30>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:43.767160 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e25c2f89-60b6-4704-83dd-0ded862ac6cf tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd" status: 200 len: 288 microversion: 2.1 time: 0.033636 May 10 14:06:43.768079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 485/945] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 14:06:43 2022] GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:43.778718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-760a04dd-d345-4ab4-987b-2d79b2dc9b45 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f76f3edc0>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:43.834471 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-760a04dd-d345-4ab4-987b-2d79b2dc9b45 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd" status: 202 len: 0 microversion: 2.1 time: 0.059414 May 10 14:06:43.835042 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 461/946] 10.222.0.49 () {58 vars in 1253 bytes} [Tue May 10 14:06:43 2022] DELETE /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:06:43.843335 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e156da43-61cb-40e0-a60d-6c5d6b77094f tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f767bf700>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:43.874345 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e156da43-61cb-40e0-a60d-6c5d6b77094f tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd" status: 200 len: 287 microversion: 2.1 time: 0.034693 May 10 14:06:43.874919 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 486/947] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 14:06:43 2022] GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:44.093504 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-78d04827-31d2-40b0-81ed-75ac3e178bfb tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:44.094041 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-78d04827-31d2-40b0-81ed-75ac3e178bfb tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] [instance: b6f9e236-1f12-4d97-8e69-ab2a7f5588a6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:44.100463 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-78d04827-31d2-40b0-81ed-75ac3e178bfb tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:44.100912 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-78d04827-31d2-40b0-81ed-75ac3e178bfb tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:44.101716 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-78d04827-31d2-40b0-81ed-75ac3e178bfb tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:44.102155 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-78d04827-31d2-40b0-81ed-75ac3e178bfb tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:44.115489 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-78d04827-31d2-40b0-81ed-75ac3e178bfb tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] HTTP exception thrown: Instance b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 could not be found. May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-78d04827-31d2-40b0-81ed-75ac3e178bfb tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Request method failure captured: May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 HTTP/1.1 May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABienFMUtUVvAKXSXgJsyM3V_cabnEuZKG8AE4Smo5Ug5Ns_VBc8ryfoLBjOEzilYsGJK7qndJMwQEofrsdLW4WW_8h2WNFaUJutYXsWPxQBnKknIdCgT4eT3NhC5XGmZosQvvLNHjsUpf2QpEiwhnIsXuc4YYKY6M3nEo8mBbQftYl4Z4 May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 7a263551cedd420db2fb5b24a60835b8 May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-VolumesActionsTest-1150416183 May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:06:44.117138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:06:44.118762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7a263551cedd420db2fb5b24a60835b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7a263551cedd420db2fb5b24a60835b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7a263551cedd420db2fb5b24a60835b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7a263551cedd420db2fb5b24a60835b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:44.118762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-VolumesActionsTest-1150416183 May 10 14:06:44.118762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 7a263551cedd420db2fb5b24a60835b8 May 10 14:06:44.118762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-VolumesActionsTest-1150416183 May 10 14:06:44.118762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-VolumesActionsTest-1150416183-project May 10 14:06:44.118762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:06:44.118762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:06:44.118762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 2ff9c506880e45bd87a16af67e107eec May 10 14:06:44.118762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-VolumesActionsTest-1150416183-project May 10 14:06:44.118762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:06:44.118762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 could not be found. May 10 14:06:44.118762 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': 'b6f9e236-1f12-4d97-8e69-ab2a7f5588a6'} May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 could not be found. May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:44.119668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 could not be found. May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 could not be found. May 10 14:06:44.121217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:44.122790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-78d04827-31d2-40b0-81ed-75ac3e178bfb tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] Returning 404 to user: Instance b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:44.122790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-78d04827-31d2-40b0-81ed-75ac3e178bfb tempest-VolumesActionsTest-1150416183 tempest-VolumesActionsTest-1150416183-project] 10.222.0.49 "GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6" status: 404 len: 111 microversion: 2.1 time: 0.029424 May 10 14:06:44.122790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 462/948] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:06:44 2022] GET /compute/v2.1/servers/b6f9e236-1f12-4d97-8e69-ab2a7f5588a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:44.887860 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1a09f09d-a8c7-4089-9747-4b6c98b22929 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f767bf1f0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:44.913845 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-1a09f09d-a8c7-4089-9747-4b6c98b22929 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] HTTP exception thrown: Snapshot 0779daeb-9786-46a0-a07f-43ac7d0f93cd could not be found. May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1a09f09d-a8c7-4089-9747-4b6c98b22929 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Request method failure captured: May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd HTTP/1.1 May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABienFuKBo0Ylso9_6_mILb93LsBypFZFL1Pm0Tp__jFd8_2V2CvruYfSN95pQtjBvZgm4oH_a6tZ9mjvehLBcq-tepawHx2ZtOq21nE7yqAm1pqqACkqAOD8yKTijEYPGasO9CdKUAXvKpD82IpvaUTvIp7jfKqkYTA5UOhCOFls1UgEU May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 1d109b97714b4d8faba191eae7f2c68c May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-200276342 May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:06:44.916223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-VolumesSnapshotsTestJSON-200276342 May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 1d109b97714b4d8faba191eae7f2c68c May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-200276342 May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-VolumesSnapshotsTestJSON-200276342-project May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 0679bb29f1624fc69dbbbcffdd846a6e May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-VolumesSnapshotsTestJSON-200276342-project May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Snapshot 0779daeb-9786-46a0-a07f-43ac7d0f93cd could not be found. May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '0779daeb-9786-46a0-a07f-43ac7d0f93cd'} May 10 14:06:44.917829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0779daeb-9786-46a0-a07f-43ac7d0f93cd could not be found. (HTTP 404) (Request-ID: req-fbcf8925-3262-4d27-8a0a-e72d1bac2727) May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:44.919057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:06:44.920450 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0779daeb-9786-46a0-a07f-43ac7d0f93cd could not be found. May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 14:06:44.922159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0779daeb-9786-46a0-a07f-43ac7d0f93cd could not be found. May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0779daeb-9786-46a0-a07f-43ac7d0f93cd could not be found. May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1a09f09d-a8c7-4089-9747-4b6c98b22929 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Returning 404 to user: Snapshot 0779daeb-9786-46a0-a07f-43ac7d0f93cd could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1a09f09d-a8c7-4089-9747-4b6c98b22929 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd" status: 404 len: 111 microversion: 2.1 time: 0.034570 May 10 14:06:44.923619 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 487/949] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 14:06:44 2022] GET /compute/v2.1/os-snapshots/0779daeb-9786-46a0-a07f-43ac7d0f93cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:44.927928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f771ab51-db60-481c-8eeb-b5b9f2e5e120 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f76f3eee0>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:44.990284 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f771ab51-db60-481c-8eeb-b5b9f2e5e120 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841" status: 202 len: 0 microversion: 2.1 time: 0.066760 May 10 14:06:44.990930 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 463/950] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 14:06:44 2022] DELETE /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:06:44.999903 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-adcf31df-8181-41c8-8262-6cb1d42dd77d tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f7c0be670>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:45.052293 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-adcf31df-8181-41c8-8262-6cb1d42dd77d tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841" status: 200 len: 344 microversion: 2.1 time: 0.056209 May 10 14:06:45.052868 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 488/951] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:06:44 2022] GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:46.065979 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fd910b6a-f1bf-4ed9-b943-6a41825f61a9 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f7c07aa60>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:46.111122 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fd910b6a-f1bf-4ed9-b943-6a41825f61a9 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841" status: 200 len: 344 microversion: 2.1 time: 0.050027 May 10 14:06:46.112236 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 464/952] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:06:46 2022] GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:47.123682 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-360fb152-8178-4e8c-8552-dc24e93836ff tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f767bf1f0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:47.168999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-360fb152-8178-4e8c-8552-dc24e93836ff tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841" status: 200 len: 344 microversion: 2.1 time: 0.049565 May 10 14:06:47.169555 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 489/953] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:06:47 2022] GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:48.181903 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-00ff4c23-4063-456e-b40f-91f599214489 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f76ff6160>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:48.227904 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-00ff4c23-4063-456e-b40f-91f599214489 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841" status: 200 len: 344 microversion: 2.1 time: 0.050503 May 10 14:06:48.228563 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 465/954] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:06:48 2022] GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:49.242862 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c811261a-c6b2-4d6d-a6df-ed0c8fd1db5c tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f7c0a4f70>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:49.286017 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-c811261a-c6b2-4d6d-a6df-ed0c8fd1db5c tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] HTTP exception thrown: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c811261a-c6b2-4d6d-a6df-ed0c8fd1db5c tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Request method failure captured: May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 HTTP/1.1 May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABienFuKBo0Ylso9_6_mILb93LsBypFZFL1Pm0Tp__jFd8_2V2CvruYfSN95pQtjBvZgm4oH_a6tZ9mjvehLBcq-tepawHx2ZtOq21nE7yqAm1pqqACkqAOD8yKTijEYPGasO9CdKUAXvKpD82IpvaUTvIp7jfKqkYTA5UOhCOFls1UgEU May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 1d109b97714b4d8faba191eae7f2c68c May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-200276342 May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:06:49.287984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-VolumesSnapshotsTestJSON-200276342 May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 1d109b97714b4d8faba191eae7f2c68c May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-200276342 May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-VolumesSnapshotsTestJSON-200276342-project May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 0679bb29f1624fc69dbbbcffdd846a6e May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-VolumesSnapshotsTestJSON-200276342-project May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': 'b69b4eb0-a28a-4dec-93d1-7622f81da841'} May 10 14:06:49.289492 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. (HTTP 404) (Request-ID: req-3c3070e1-16a5-42fc-a254-4c4db93423fd) May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:49.290316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:06:49.291657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 14:06:49.293075 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c811261a-c6b2-4d6d-a6df-ed0c8fd1db5c tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Returning 404 to user: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c811261a-c6b2-4d6d-a6df-ed0c8fd1db5c tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841" status: 404 len: 109 microversion: 2.1 time: 0.051640 May 10 14:06:49.294529 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 490/955] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:06:49 2022] GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:49.302281 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-40626238-5846-4a8b-80f5-be582f86e694 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f7c038160>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:49.342034 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-40626238-5846-4a8b-80f5-be582f86e694 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] HTTP exception thrown: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-40626238-5846-4a8b-80f5-be582f86e694 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Request method failure captured: May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: DELETE /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 HTTP/1.1 May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABienFuKBo0Ylso9_6_mILb93LsBypFZFL1Pm0Tp__jFd8_2V2CvruYfSN95pQtjBvZgm4oH_a6tZ9mjvehLBcq-tepawHx2ZtOq21nE7yqAm1pqqACkqAOD8yKTijEYPGasO9CdKUAXvKpD82IpvaUTvIp7jfKqkYTA5UOhCOFls1UgEU May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 1d109b97714b4d8faba191eae7f2c68c May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-200276342 May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:06:49.344443 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-VolumesSnapshotsTestJSON-200276342 May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 1d109b97714b4d8faba191eae7f2c68c May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-200276342 May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-VolumesSnapshotsTestJSON-200276342-project May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 0679bb29f1624fc69dbbbcffdd846a6e May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-VolumesSnapshotsTestJSON-200276342-project May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': 'b69b4eb0-a28a-4dec-93d1-7622f81da841'} May 10 14:06:49.346662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. (HTTP 404) (Request-ID: req-71b241c5-4739-4b72-9630-f5875eaaa174) May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:49.348790 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:06:49.350323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 14:06:49.351788 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-40626238-5846-4a8b-80f5-be582f86e694 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Returning 404 to user: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-40626238-5846-4a8b-80f5-be582f86e694 tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841" status: 404 len: 109 microversion: 2.1 time: 0.047542 May 10 14:06:49.353161 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 466/956] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 14:06:49 2022] DELETE /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:49.360681 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-aa56126b-3dae-4d26-8f35-abdc1f85141c tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Calling method '.version_select at 0x7f5f7c0a4ee0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:49.409975 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-aa56126b-3dae-4d26-8f35-abdc1f85141c tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] HTTP exception thrown: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-aa56126b-3dae-4d26-8f35-abdc1f85141c tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Request method failure captured: May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 HTTP/1.1 May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABienFuKBo0Ylso9_6_mILb93LsBypFZFL1Pm0Tp__jFd8_2V2CvruYfSN95pQtjBvZgm4oH_a6tZ9mjvehLBcq-tepawHx2ZtOq21nE7yqAm1pqqACkqAOD8yKTijEYPGasO9CdKUAXvKpD82IpvaUTvIp7jfKqkYTA5UOhCOFls1UgEU May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 1d109b97714b4d8faba191eae7f2c68c May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-200276342 May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:06:49.412197 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d109b97714b4d8faba191eae7f2c68c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-VolumesSnapshotsTestJSON-200276342 May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 1d109b97714b4d8faba191eae7f2c68c May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-200276342 May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-VolumesSnapshotsTestJSON-200276342-project May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 0679bb29f1624fc69dbbbcffdd846a6e May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-VolumesSnapshotsTestJSON-200276342-project May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': 'b69b4eb0-a28a-4dec-93d1-7622f81da841'} May 10 14:06:49.413801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. (HTTP 404) (Request-ID: req-522edcd4-0a96-4f73-85ef-351b89e866d4) May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:49.414758 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:06:49.416216 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 14:06:49.417650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-aa56126b-3dae-4d26-8f35-abdc1f85141c tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] Returning 404 to user: Volume b69b4eb0-a28a-4dec-93d1-7622f81da841 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-aa56126b-3dae-4d26-8f35-abdc1f85141c tempest-VolumesSnapshotsTestJSON-200276342 tempest-VolumesSnapshotsTestJSON-200276342-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841" status: 404 len: 109 microversion: 2.1 time: 0.058509 May 10 14:06:49.419695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 491/957] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:06:49 2022] GET /compute/v2.1/os-volumes/b69b4eb0-a28a-4dec-93d1-7622f81da841 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:53.083049 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4e63359a-01e0-4b09-bd12-e991ff60126c tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] Calling method '.version_select at 0x7f5f76ff6c10>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:53.161377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4e63359a-01e0-4b09-bd12-e991ff60126c tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2cc1e608-8efc-4db2-bfe4-d8e5a6381abb" status: 200 len: 350 microversion: 2.1 time: 0.081892 May 10 14:06:53.161377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 467/958] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:06:53 2022] GET /compute/v2.1/os-volumes/2cc1e608-8efc-4db2-bfe4-d8e5a6381abb => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:54.658665 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-89a4912a-6064-4265-850b-351754149531 tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] Calling method '.version_select at 0x7f5f7c0be040>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:54.778782 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-89a4912a-6064-4265-850b-351754149531 tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c1d56afb-863d-4bf8-93c1-a98fe68992d3" status: 200 len: 351 microversion: 2.1 time: 0.126306 May 10 14:06:54.780320 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 492/959] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:06:54 2022] GET /compute/v2.1/os-volumes/c1d56afb-863d-4bf8-93c1-a98fe68992d3 => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:56.232979 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-19747111-5526-46e1-904c-58abe7344834 tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] Calling method '.version_select at 0x7f5f76f14790>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:56.295428 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-19747111-5526-46e1-904c-58abe7344834 tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/6366587c-c3ec-4097-a05f-2595b8d09457" status: 200 len: 350 microversion: 2.1 time: 0.066917 May 10 14:06:56.296107 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 468/960] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:06:56 2022] GET /compute/v2.1/os-volumes/6366587c-c3ec-4097-a05f-2595b8d09457 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:56.310797 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-103654dc-7651-4772-a408-1ce1dc90f1b9 tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] Calling method '.version_select at 0x7f5f7c0be040>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:56.472562 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-103654dc-7651-4772-a408-1ce1dc90f1b9 tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.167966 May 10 14:06:56.473342 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 493/961] 10.222.0.49 () {58 vars in 1133 bytes} [Tue May 10 14:06:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:56.486805 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0ebadf3b-4d69-4cf7-934a-05a1fe753e77 tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] Calling method '.version_select at 0x7f5f76f3e0d0>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:56.615181 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0ebadf3b-4d69-4cf7-934a-05a1fe753e77 tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.132861 May 10 14:06:56.626989 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 469/962] 10.222.0.49 () {58 vars in 1148 bytes} [Tue May 10 14:06:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:56.633819 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3d8614b3-56e9-4d31-bf43-3c88f572363f tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] Calling method '.version_select at 0x7f5f767bfc10>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:56.791564 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3d8614b3-56e9-4d31-bf43-3c88f572363f tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.162014 May 10 14:06:56.792443 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 494/963] 10.222.0.49 () {58 vars in 1133 bytes} [Tue May 10 14:06:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:06:56.804055 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-382bbc88-64e8-4eab-9965-be6bdbd2e189 tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] Calling method '.version_select at 0x7f5f76f148b0>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:56.940820 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-382bbc88-64e8-4eab-9965-be6bdbd2e189 tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.140531 May 10 14:06:56.948911 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 470/964] 10.222.0.49 () {58 vars in 1166 bytes} [Tue May 10 14:06:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:56.955355 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-93000f7a-431e-4b56-b4f3-a1ed2eef013a tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] Calling method '.version_select at 0x7f5f7c022310>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:57.051826 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-93000f7a-431e-4b56-b4f3-a1ed2eef013a tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.100372 May 10 14:06:57.052434 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 495/965] 10.222.0.49 () {58 vars in 1169 bytes} [Tue May 10 14:06:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:06:57.065695 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-55c42c6f-bfa3-4535-b5e2-994f573bad3e tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] Calling method '.version_select at 0x7f5f76f163a0>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:57.158789 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-55c42c6f-bfa3-4535-b5e2-994f573bad3e tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.097311 May 10 14:06:57.170634 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 471/966] 10.222.0.49 () {58 vars in 1154 bytes} [Tue May 10 14:06:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:57.176555 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-04012125-e450-427c-9565-88e5ada702c5 tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] Calling method '.version_select at 0x7f5f767ce430>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:57.279175 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-04012125-e450-427c-9565-88e5ada702c5 tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.107045 May 10 14:06:57.280020 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 496/967] 10.222.0.49 () {58 vars in 1187 bytes} [Tue May 10 14:06:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:57.292694 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2838c64a-4481-4d2f-b55b-75604564e57f tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] Calling method '.version_select at 0x7f5f76fa29d0>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:57.385632 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2838c64a-4481-4d2f-b55b-75604564e57f tempest-VolumesTestJSON-1940840965 tempest-VolumesTestJSON-1940840965-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.097247 May 10 14:06:57.386216 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 472/968] 10.222.0.49 () {58 vars in 1154 bytes} [Tue May 10 14:06:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:07:01.264957 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5d423c0b-4ff9-4a3a-8642-452fb584ccb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:01.266151 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5d423c0b-4ff9-4a3a-8642-452fb584ccb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:01.275787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5d423c0b-4ff9-4a3a-8642-452fb584ccb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:01.276263 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5d423c0b-4ff9-4a3a-8642-452fb584ccb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:01.277269 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5d423c0b-4ff9-4a3a-8642-452fb584ccb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:01.277709 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5d423c0b-4ff9-4a3a-8642-452fb584ccb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:01.309029 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5d423c0b-4ff9-4a3a-8642-452fb584ccb1 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050321 May 10 14:07:01.309943 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 497/969] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 14:07:01 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:01.382029 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-865f2b46-8c42-4742-a949-547763f99c8d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:01.383444 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-865f2b46-8c42-4742-a949-547763f99c8d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:01.391885 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-865f2b46-8c42-4742-a949-547763f99c8d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:01.393051 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-865f2b46-8c42-4742-a949-547763f99c8d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:01.394018 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-865f2b46-8c42-4742-a949-547763f99c8d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:01.394608 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-865f2b46-8c42-4742-a949-547763f99c8d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:01.423611 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-865f2b46-8c42-4742-a949-547763f99c8d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Going to try to terminate instance {{(pid=117153) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:07:01.512229 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-865f2b46-8c42-4742-a949-547763f99c8d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "DELETE /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 204 len: 0 microversion: 2.20 time: 0.134299 May 10 14:07:01.513494 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 473/970] 10.222.0.49 () {60 vars in 1279 bytes} [Tue May 10 14:07:01 2022] DELETE /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 14:07:01.521573 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-4e93c266-a7a6-4d30-ba0e-3681f795373a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:01.522476 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-4e93c266-a7a6-4d30-ba0e-3681f795373a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:01.529313 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4e93c266-a7a6-4d30-ba0e-3681f795373a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:01.530058 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4e93c266-a7a6-4d30-ba0e-3681f795373a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:01.531122 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4e93c266-a7a6-4d30-ba0e-3681f795373a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:01.531756 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4e93c266-a7a6-4d30-ba0e-3681f795373a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:01.673736 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-4e93c266-a7a6-4d30-ba0e-3681f795373a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:01.683133 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-4e93c266-a7a6-4d30-ba0e-3681f795373a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:01.684618 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-4e93c266-a7a6-4d30-ba0e-3681f795373a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:01.685801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-4e93c266-a7a6-4d30-ba0e-3681f795373a tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.168110 May 10 14:07:01.686430 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 498/971] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:07:01 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:07:02.705223 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4a3f1726-e69b-42db-8656-5ad6fab67fc8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:02.706512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4a3f1726-e69b-42db-8656-5ad6fab67fc8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:02.714543 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4a3f1726-e69b-42db-8656-5ad6fab67fc8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:02.715155 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4a3f1726-e69b-42db-8656-5ad6fab67fc8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:02.716510 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4a3f1726-e69b-42db-8656-5ad6fab67fc8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:02.717149 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4a3f1726-e69b-42db-8656-5ad6fab67fc8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:02.865523 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4a3f1726-e69b-42db-8656-5ad6fab67fc8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:02.875427 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4a3f1726-e69b-42db-8656-5ad6fab67fc8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:02.879173 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4a3f1726-e69b-42db-8656-5ad6fab67fc8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:02.881162 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4a3f1726-e69b-42db-8656-5ad6fab67fc8 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.180535 May 10 14:07:02.882861 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 474/972] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:07:02 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:07:03.900920 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2ec622a3-8c0d-4219-9142-0bf2c2f3009d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:03.902222 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2ec622a3-8c0d-4219-9142-0bf2c2f3009d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:03.911643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ec622a3-8c0d-4219-9142-0bf2c2f3009d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:03.913591 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ec622a3-8c0d-4219-9142-0bf2c2f3009d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:03.914774 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ec622a3-8c0d-4219-9142-0bf2c2f3009d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:03.916652 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2ec622a3-8c0d-4219-9142-0bf2c2f3009d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:04.229916 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2ec622a3-8c0d-4219-9142-0bf2c2f3009d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:04.242853 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2ec622a3-8c0d-4219-9142-0bf2c2f3009d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:04.246024 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2ec622a3-8c0d-4219-9142-0bf2c2f3009d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:04.247282 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2ec622a3-8c0d-4219-9142-0bf2c2f3009d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1724 microversion: 2.20 time: 0.350601 May 10 14:07:04.251118 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 499/973] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:07:03 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:07:04.981992 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-af7e7f4b-5d6e-470e-b534-bb3262355ef2 req-420e99d0-29a7-4f3d-a040-e1131fbd8a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e6e847-c76f-441e-a7f8-63251b198a2d", "name": "network-vif-deleted", "tag": "7c7e5879-9276-48c6-9f02-0be4571c330e"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:05.017623 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-af7e7f4b-5d6e-470e-b534-bb3262355ef2 req-420e99d0-29a7-4f3d-a040-e1131fbd8a3a service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:05.021565 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-af7e7f4b-5d6e-470e-b534-bb3262355ef2 req-420e99d0-29a7-4f3d-a040-e1131fbd8a3a service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:05.057617 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-af7e7f4b-5d6e-470e-b534-bb3262355ef2 req-420e99d0-29a7-4f3d-a040-e1131fbd8a3a service nova] Creating event network-vif-deleted:7c7e5879-9276-48c6-9f02-0be4571c330e for instance 18e6e847-c76f-441e-a7f8-63251b198a2d on hv-cinder-84067 May 10 14:07:05.074525 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-af7e7f4b-5d6e-470e-b534-bb3262355ef2 req-420e99d0-29a7-4f3d-a040-e1131fbd8a3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095901 May 10 14:07:05.081152 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 475/974] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:05.273684 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:05.274395 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:05.282515 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:05.282973 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:05.283864 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:05.284521 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:05.339505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:05.340146 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:05.340877 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lazy-loading 'fault' on Instance uuid 18e6e847-c76f-441e-a7f8-63251b198a2d {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:07:05.418823 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:05.428310 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:05.429648 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67535c1c99484689999ef478604e51d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39c2a00ace4575896bf3f045bedce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:05.430811 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-89b20c28-7c5b-4fb9-9078-d7b1402fe71d tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 200 len: 1372 microversion: 2.20 time: 0.163891 May 10 14:07:05.441281 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 500/975] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:07:05 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:07:06.468579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b6d366af-68ec-4e45-aca6-4779510fc471 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:06.471661 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-b6d366af-68ec-4e45-aca6-4779510fc471 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:06.490374 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6d366af-68ec-4e45-aca6-4779510fc471 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:06.494072 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6d366af-68ec-4e45-aca6-4779510fc471 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:06.497397 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6d366af-68ec-4e45-aca6-4779510fc471 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:06.498361 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-b6d366af-68ec-4e45-aca6-4779510fc471 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:06.531981 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-b6d366af-68ec-4e45-aca6-4779510fc471 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] HTTP exception thrown: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b6d366af-68ec-4e45-aca6-4779510fc471 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Request method failure captured: May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d HTTP/1.1 May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_s75McvgWhPruNL1rqCZYcJx0qi1L1AZfbVPbZ-4Kr9rTtMueP7uUYxVYHCTgjW3Pjz-S2f9ymiA-VANjfjFPqE9_vyYAFkNnckOBVsFToAmU_HnpnSu65_TAZwTKt0HLMTMUvTjzS5OM91Xl4n-9BAgKku4ZBfKrwxbFhPZe1XWE May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: dd39c2a00ace4575896bf3f045bedce1 May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:07:06.534434 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:07:06.536487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:07:06.536487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:06.536487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: dd39c2a00ace4575896bf3f045bedce1 May 10 14:07:06.536487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:06.536487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-AttachVolumeShelveTestJSON-1426318459-project May 10 14:07:06.536487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:07:06.536487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:07:06.536487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 67535c1c99484689999ef478604e51d0 May 10 14:07:06.536487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1426318459-project May 10 14:07:06.536487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:07:06.536487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:06.536487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '18e6e847-c76f-441e-a7f8-63251b198a2d'} May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:07:06.537697 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:06.538918 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:06.540041 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-b6d366af-68ec-4e45-aca6-4779510fc471 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Returning 404 to user: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:07:06.540041 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-b6d366af-68ec-4e45-aca6-4779510fc471 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 404 len: 111 microversion: 2.20 time: 0.080565 May 10 14:07:06.543337 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 476/976] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:07:06 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:07:06.547260 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bcad11ed-15e9-49b8-9094-2795ea16b552 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '.version_select at 0x7f5f7c0225e0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:06.629636 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-bcad11ed-15e9-49b8-9094-2795ea16b552 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1287782749" status: 204 len: 0 microversion: 2.20 time: 0.087315 May 10 14:07:06.630235 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 501/977] 10.222.0.49 () {60 vars in 1261 bytes} [Tue May 10 14:07:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1287782749 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 14:07:08.956593 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c1533a27-fb3b-4a8d-b9b3-d406cd439f7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:08.956593 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c1533a27-fb3b-4a8d-b9b3-d406cd439f7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:08.962096 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c1533a27-fb3b-4a8d-b9b3-d406cd439f7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:08.962547 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c1533a27-fb3b-4a8d-b9b3-d406cd439f7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:08.963359 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c1533a27-fb3b-4a8d-b9b3-d406cd439f7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:08.963802 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c1533a27-fb3b-4a8d-b9b3-d406cd439f7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:08.980889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-c1533a27-fb3b-4a8d-b9b3-d406cd439f7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] HTTP exception thrown: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c1533a27-fb3b-4a8d-b9b3-d406cd439f7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Request method failure captured: May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: DELETE /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d HTTP/1.1 May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_s75McvgWhPruNL1rqCZYcJx0qi1L1AZfbVPbZ-4Kr9rTtMueP7uUYxVYHCTgjW3Pjz-S2f9ymiA-VANjfjFPqE9_vyYAFkNnckOBVsFToAmU_HnpnSu65_TAZwTKt0HLMTMUvTjzS5OM91Xl4n-9BAgKku4ZBfKrwxbFhPZe1XWE May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: dd39c2a00ace4575896bf3f045bedce1 May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:07:08.982635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:07:08.984440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:07:08.984440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:08.984440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: dd39c2a00ace4575896bf3f045bedce1 May 10 14:07:08.984440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:08.984440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-AttachVolumeShelveTestJSON-1426318459-project May 10 14:07:08.984440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:07:08.984440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:07:08.984440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 67535c1c99484689999ef478604e51d0 May 10 14:07:08.984440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1426318459-project May 10 14:07:08.984440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:07:08.984440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:08.984440 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '18e6e847-c76f-441e-a7f8-63251b198a2d'} May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:07:08.985400 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:08.986928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:08.989785 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c1533a27-fb3b-4a8d-b9b3-d406cd439f7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Returning 404 to user: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:07:08.991763 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c1533a27-fb3b-4a8d-b9b3-d406cd439f7f tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "DELETE /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 404 len: 111 microversion: 2.20 time: 0.040788 May 10 14:07:08.993679 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 477/978] 10.222.0.49 () {60 vars in 1279 bytes} [Tue May 10 14:07:08 2022] DELETE /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:07:09.003166 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bb1a8911-710d-43f0-bad0-e5cf80b42a11 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:09.003912 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-bb1a8911-710d-43f0-bad0-e5cf80b42a11 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 18e6e847-c76f-441e-a7f8-63251b198a2d] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:09.017083 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bb1a8911-710d-43f0-bad0-e5cf80b42a11 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:09.018440 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bb1a8911-710d-43f0-bad0-e5cf80b42a11 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:09.019452 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bb1a8911-710d-43f0-bad0-e5cf80b42a11 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:09.020391 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bb1a8911-710d-43f0-bad0-e5cf80b42a11 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:09.038560 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-bb1a8911-710d-43f0-bad0-e5cf80b42a11 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] HTTP exception thrown: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bb1a8911-710d-43f0-bad0-e5cf80b42a11 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Request method failure captured: May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d HTTP/1.1 May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_s75McvgWhPruNL1rqCZYcJx0qi1L1AZfbVPbZ-4Kr9rTtMueP7uUYxVYHCTgjW3Pjz-S2f9ymiA-VANjfjFPqE9_vyYAFkNnckOBVsFToAmU_HnpnSu65_TAZwTKt0HLMTMUvTjzS5OM91Xl4n-9BAgKku4ZBfKrwxbFhPZe1XWE May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: dd39c2a00ace4575896bf3f045bedce1 May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:07:09.040905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:07:09.042651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:07:09.042651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:09.042651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: dd39c2a00ace4575896bf3f045bedce1 May 10 14:07:09.042651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:09.042651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeShelveTestJSON-1426318459-project May 10 14:07:09.042651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:07:09.042651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:07:09.042651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 67535c1c99484689999ef478604e51d0 May 10 14:07:09.042651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1426318459-project May 10 14:07:09.042651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:07:09.042651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:09.042651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '18e6e847-c76f-441e-a7f8-63251b198a2d'} May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:07:09.043794 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. May 10 14:07:09.045343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:09.046922 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bb1a8911-710d-43f0-bad0-e5cf80b42a11 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Returning 404 to user: Instance 18e6e847-c76f-441e-a7f8-63251b198a2d could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:07:09.046922 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-bb1a8911-710d-43f0-bad0-e5cf80b42a11 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d" status: 404 len: 111 microversion: 2.20 time: 0.044490 May 10 14:07:09.056890 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 502/979] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:07:08 2022] GET /compute/v2.1/servers/18e6e847-c76f-441e-a7f8-63251b198a2d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 14:07:12.314890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8324765f-8fb8-4064-9e13-87ad43e91f4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:12.315996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8324765f-8fb8-4064-9e13-87ad43e91f4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:12.322480 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8324765f-8fb8-4064-9e13-87ad43e91f4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:12.323007 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8324765f-8fb8-4064-9e13-87ad43e91f4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:12.323854 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8324765f-8fb8-4064-9e13-87ad43e91f4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:12.324395 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8324765f-8fb8-4064-9e13-87ad43e91f4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:12.345256 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-8324765f-8fb8-4064-9e13-87ad43e91f4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] HTTP exception thrown: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8324765f-8fb8-4064-9e13-87ad43e91f4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Request method failure captured: May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: DELETE /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 HTTP/1.1 May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABiem_s75McvgWhPruNL1rqCZYcJx0qi1L1AZfbVPbZ-4Kr9rTtMueP7uUYxVYHCTgjW3Pjz-S2f9ymiA-VANjfjFPqE9_vyYAFkNnckOBVsFToAmU_HnpnSu65_TAZwTKt0HLMTMUvTjzS5OM91Xl4n-9BAgKku4ZBfKrwxbFhPZe1XWE May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: dd39c2a00ace4575896bf3f045bedce1 May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:07:12.346996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:07:12.348498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:07:12.348498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:12.348498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: dd39c2a00ace4575896bf3f045bedce1 May 10 14:07:12.348498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:12.348498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-AttachVolumeShelveTestJSON-1426318459-project May 10 14:07:12.348498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:07:12.348498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:07:12.348498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 67535c1c99484689999ef478604e51d0 May 10 14:07:12.348498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1426318459-project May 10 14:07:12.348498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:07:12.348498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:07:12.348498 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '067bd8aa-a9d7-41f4-82a3-54e00fe64f68'} May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:07:12.349516 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:07:12.350860 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:07:12.352081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8324765f-8fb8-4064-9e13-87ad43e91f4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Returning 404 to user: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:07:12.352081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8324765f-8fb8-4064-9e13-87ad43e91f4c tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "DELETE /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 404 len: 111 microversion: 2.20 time: 0.037631 May 10 14:07:12.352081 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 478/980] 10.222.0.49 () {60 vars in 1279 bytes} [Tue May 10 14:07:12 2022] DELETE /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:07:12.359915 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-082cb676-5e76-4149-a7d8-a98eebb5ecf0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:12.360739 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-082cb676-5e76-4149-a7d8-a98eebb5ecf0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] [instance: 067bd8aa-a9d7-41f4-82a3-54e00fe64f68] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:12.380530 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-082cb676-5e76-4149-a7d8-a98eebb5ecf0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:12.381098 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-082cb676-5e76-4149-a7d8-a98eebb5ecf0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:12.382274 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-082cb676-5e76-4149-a7d8-a98eebb5ecf0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:12.382933 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-082cb676-5e76-4149-a7d8-a98eebb5ecf0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:12.402079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-082cb676-5e76-4149-a7d8-a98eebb5ecf0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] HTTP exception thrown: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-082cb676-5e76-4149-a7d8-a98eebb5ecf0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Request method failure captured: May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 HTTP/1.1 May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABiem_s75McvgWhPruNL1rqCZYcJx0qi1L1AZfbVPbZ-4Kr9rTtMueP7uUYxVYHCTgjW3Pjz-S2f9ymiA-VANjfjFPqE9_vyYAFkNnckOBVsFToAmU_HnpnSu65_TAZwTKt0HLMTMUvTjzS5OM91Xl4n-9BAgKku4ZBfKrwxbFhPZe1XWE May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: dd39c2a00ace4575896bf3f045bedce1 May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:07:12.402701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:07:12.404479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd39c2a00ace4575896bf3f045bedce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:07:12.404479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:12.404479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: dd39c2a00ace4575896bf3f045bedce1 May 10 14:07:12.404479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1426318459 May 10 14:07:12.404479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-AttachVolumeShelveTestJSON-1426318459-project May 10 14:07:12.404479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:07:12.404479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:07:12.404479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 67535c1c99484689999ef478604e51d0 May 10 14:07:12.404479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1426318459-project May 10 14:07:12.404479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:07:12.404479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:07:12.404479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '067bd8aa-a9d7-41f4-82a3-54e00fe64f68'} May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:07:12.405346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. May 10 14:07:12.406987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:12.408340 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-082cb676-5e76-4149-a7d8-a98eebb5ecf0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] Returning 404 to user: Instance 067bd8aa-a9d7-41f4-82a3-54e00fe64f68 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:07:12.408340 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-082cb676-5e76-4149-a7d8-a98eebb5ecf0 tempest-AttachVolumeShelveTestJSON-1426318459 tempest-AttachVolumeShelveTestJSON-1426318459-project] 10.222.0.49 "GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68" status: 404 len: 111 microversion: 2.20 time: 0.048127 May 10 14:07:12.408340 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 503/981] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 14:07:12 2022] GET /compute/v2.1/servers/067bd8aa-a9d7-41f4-82a3-54e00fe64f68 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:07:16.831733 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1925684911", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-379745293", "security_groups": [{"name": "tempest-secgroup-smoke-821776293"}], "block_device_mapping_v2": [{"uuid": "1593818b-6fdf-46bc-b634-42c4040d86a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3ef3499-58c5-4573-b70a-3147dbe30f92"}]}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:16.957310 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.network.neutron [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] validate_networks() for [('c3ef3499-58c5-4573-b70a-3147dbe30f92', None, None, None, None, None)] {{(pid=117153) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:07:17.456944 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Flavor limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:07:17.457395 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Image limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:07:17.457919 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Flavor pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:07:17.458340 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Image pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:07:17.458782 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:07:17.469013 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:17.469463 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:17.470276 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:17.470715 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:17.490451 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Getting quotas for project 104740054c3a47ca8cc3cb262d975fd5. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:07:17.495354 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Getting quotas for user 9d87a4de3fbf4cbb9e21523634007629 and project 104740054c3a47ca8cc3cb262d975fd5. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:07:17.559000 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Going to run 1 instances... {{(pid=117153) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:07:17.561083 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1593818b-6fdf-46bc-b634-42c4040d86a2',volume_size=None,volume_type=None)] {{(pid=117153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:07:17.695392 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-47a0d6b8-1287-49b5-ad54-6cd861f777e2 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.867609 May 10 14:07:17.701180 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 479/982] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:07:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:07:17.714357 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-14d6b126-ebfb-4f6b-b42a-3b4dc1eb3f91 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:17.714980 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-14d6b126-ebfb-4f6b-b42a-3b4dc1eb3f91 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:17.792190 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-14d6b126-ebfb-4f6b-b42a-3b4dc1eb3f91 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:17.801418 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-14d6b126-ebfb-4f6b-b42a-3b4dc1eb3f91 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1094 microversion: 2.1 time: 0.098412 May 10 14:07:17.810987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 504/983] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:17 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:18.273420 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8c3b86d3-f563-43c3-bc9e-fe78f431b9c1 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] Action: 'create', calling method: .version_select at 0x7f5f76f16b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1454519912", "metadata": {"Type": "work"}}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:18.573738 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8c3b86d3-f563-43c3-bc9e-fe78f431b9c1 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.430156 May 10 14:07:18.574354 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 480/984] 10.222.0.49 () {60 vars in 1155 bytes} [Tue May 10 14:07:18 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 431 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 14:07:18.586621 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2f865aa9-c599-49a0-bcdf-973317c90dc1 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] Calling method '.version_select at 0x7f5f7c073160>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:18.642223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2f865aa9-c599-49a0-bcdf-973317c90dc1 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc" status: 200 len: 353 microversion: 2.1 time: 0.060077 May 10 14:07:18.643306 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 505/985] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:07:18 2022] GET /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:18.823765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-77946014-eb17-4c96-8373-ba11c3cbc56c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:18.824448 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-77946014-eb17-4c96-8373-ba11c3cbc56c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:18.831097 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-77946014-eb17-4c96-8373-ba11c3cbc56c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:18.831607 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-77946014-eb17-4c96-8373-ba11c3cbc56c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:18.836501 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-77946014-eb17-4c96-8373-ba11c3cbc56c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:18.837416 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-77946014-eb17-4c96-8373-ba11c3cbc56c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:18.931597 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-77946014-eb17-4c96-8373-ba11c3cbc56c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:18.940939 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-77946014-eb17-4c96-8373-ba11c3cbc56c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1210 microversion: 2.1 time: 0.120788 May 10 14:07:18.941863 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 481/986] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:18 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1210 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:19.656184 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ecf7d2f4-f159-45f3-afa4-2a6e918a0f12 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] Calling method '.version_select at 0x7f5f7c0a48b0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:19.715728 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ecf7d2f4-f159-45f3-afa4-2a6e918a0f12 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc" status: 200 len: 354 microversion: 2.1 time: 0.064734 May 10 14:07:19.722640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 506/987] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:07:19 2022] GET /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:19.727746 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6fe40f7c-9b7c-4950-95eb-b381a16d48ef tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] Calling method '.version_select at 0x7f5f76f165e0>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:19.779574 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6fe40f7c-9b7c-4950-95eb-b381a16d48ef tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc" status: 200 len: 354 microversion: 2.1 time: 0.055555 May 10 14:07:19.780286 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 482/988] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:07:19 2022] GET /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:19.796314 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1fa32178-7f8e-4bdd-a664-a6f6767bb1df tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] Calling method '.version_select at 0x7f5f7c07d8b0>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:19.862988 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1fa32178-7f8e-4bdd-a664-a6f6767bb1df tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc" status: 202 len: 0 microversion: 2.1 time: 0.070412 May 10 14:07:19.866089 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 507/989] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 14:07:19 2022] DELETE /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:07:19.874917 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-70b13a72-c229-4d8c-a303-704aa6ea3271 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] Calling method '.version_select at 0x7f5f76f56f70>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:19.930953 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-70b13a72-c229-4d8c-a303-704aa6ea3271 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc" status: 200 len: 353 microversion: 2.1 time: 0.059673 May 10 14:07:19.931669 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 483/990] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:07:19 2022] GET /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:19.958146 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c8e94450-6690-477c-8c40-58aead7c203a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:19.958754 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c8e94450-6690-477c-8c40-58aead7c203a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:19.965606 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8e94450-6690-477c-8c40-58aead7c203a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:19.966237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8e94450-6690-477c-8c40-58aead7c203a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:19.967015 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8e94450-6690-477c-8c40-58aead7c203a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:19.967455 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8e94450-6690-477c-8c40-58aead7c203a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:20.113263 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c8e94450-6690-477c-8c40-58aead7c203a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:20.121282 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c8e94450-6690-477c-8c40-58aead7c203a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.167431 May 10 14:07:20.122221 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 508/991] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:19 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:20.224205 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-4cb0c8fd-0085-4bf8-b118-f4b3cbdfb67e req-13749dc8-1b43-4672-9729-76c301f38e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69343f84-e94e-4334-b040-ab048b6795ac", "tag": "6daf67e0-ce03-4c62-acf8-42fa18634144"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:20.246704 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-4cb0c8fd-0085-4bf8-b118-f4b3cbdfb67e req-13749dc8-1b43-4672-9729-76c301f38e77 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:20.247718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-4cb0c8fd-0085-4bf8-b118-f4b3cbdfb67e req-13749dc8-1b43-4672-9729-76c301f38e77 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:20.259774 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-4cb0c8fd-0085-4bf8-b118-f4b3cbdfb67e req-13749dc8-1b43-4672-9729-76c301f38e77 service nova] Creating event network-changed:6daf67e0-ce03-4c62-acf8-42fa18634144 for instance 69343f84-e94e-4334-b040-ab048b6795ac on hv-cinder-84067 May 10 14:07:20.264741 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-4cb0c8fd-0085-4bf8-b118-f4b3cbdfb67e req-13749dc8-1b43-4672-9729-76c301f38e77 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046269 May 10 14:07:20.265347 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 484/992] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:07:20.943158 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2d70f301-828d-41fd-8e76-e76ce0938ba1 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] Calling method '.version_select at 0x7f5f7c1c8c10>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:20.972514 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-2d70f301-828d-41fd-8e76-e76ce0938ba1 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] HTTP exception thrown: Volume dac75281-c2e7-4262-b809-ab5f2e2b17cc could not be found. May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2d70f301-828d-41fd-8e76-e76ce0938ba1 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] Request method failure captured: May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc HTTP/1.1 May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABienGWXxy4sSYuuSd6e-JORs1b2PIDLvtb5iEgEPHHdHQv0sotrBAnv309taAMZG1XqQYx5JncOW4IJiSSw55dwO4dSkub3rA15GOAJf3wvI0_YN9BtzaJzwUenaXV__wzQEc6XzGiFjWo2LY_Omuy8AN6lNZw-un2j8sPQA174baz15s May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: ea566cb4843d415a939a27cb0d307754 May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-VolumesGetTestJSON-1453653726 May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:07:20.974520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea566cb4843d415a939a27cb0d307754"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ea566cb4843d415a939a27cb0d307754"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ea566cb4843d415a939a27cb0d307754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea566cb4843d415a939a27cb0d307754"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-VolumesGetTestJSON-1453653726 May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: ea566cb4843d415a939a27cb0d307754 May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-VolumesGetTestJSON-1453653726 May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-VolumesGetTestJSON-1453653726-project May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 805fb1491c0145a18497562bccfb00c1 May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-VolumesGetTestJSON-1453653726-project May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Volume dac75281-c2e7-4262-b809-ab5f2e2b17cc could not be found. May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': 'dac75281-c2e7-4262-b809-ab5f2e2b17cc'} May 10 14:07:20.976139 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dac75281-c2e7-4262-b809-ab5f2e2b17cc could not be found. (HTTP 404) (Request-ID: req-c298425b-f1f2-426b-8367-2d112b15b298) May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:20.977354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:07:20.979127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dac75281-c2e7-4262-b809-ab5f2e2b17cc could not be found. May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 14:07:20.980586 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dac75281-c2e7-4262-b809-ab5f2e2b17cc could not be found. May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dac75281-c2e7-4262-b809-ab5f2e2b17cc could not be found. May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2d70f301-828d-41fd-8e76-e76ce0938ba1 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] Returning 404 to user: Volume dac75281-c2e7-4262-b809-ab5f2e2b17cc could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2d70f301-828d-41fd-8e76-e76ce0938ba1 tempest-VolumesGetTestJSON-1453653726 tempest-VolumesGetTestJSON-1453653726-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc" status: 404 len: 109 microversion: 2.1 time: 0.037175 May 10 14:07:20.982131 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 509/993] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 14:07:20 2022] GET /compute/v2.1/os-volumes/dac75281-c2e7-4262-b809-ab5f2e2b17cc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:07:21.140855 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9120c5f8-b6f3-486b-98fd-26c71ffcb440 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:21.141564 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9120c5f8-b6f3-486b-98fd-26c71ffcb440 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:21.148225 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9120c5f8-b6f3-486b-98fd-26c71ffcb440 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:21.148685 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9120c5f8-b6f3-486b-98fd-26c71ffcb440 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:21.149465 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9120c5f8-b6f3-486b-98fd-26c71ffcb440 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:21.150075 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9120c5f8-b6f3-486b-98fd-26c71ffcb440 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:21.377732 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9120c5f8-b6f3-486b-98fd-26c71ffcb440 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:21.388040 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9120c5f8-b6f3-486b-98fd-26c71ffcb440 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.252569 May 10 14:07:21.389140 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 485/994] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:21 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:22.413654 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-244c2e19-ea6d-4ce3-adb5-3b4b9e5369b1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:22.414298 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-244c2e19-ea6d-4ce3-adb5-3b4b9e5369b1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:22.420407 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-244c2e19-ea6d-4ce3-adb5-3b4b9e5369b1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:22.420867 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-244c2e19-ea6d-4ce3-adb5-3b4b9e5369b1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:22.421658 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-244c2e19-ea6d-4ce3-adb5-3b4b9e5369b1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:22.422364 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-244c2e19-ea6d-4ce3-adb5-3b4b9e5369b1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:22.573267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-244c2e19-ea6d-4ce3-adb5-3b4b9e5369b1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:22.580732 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-244c2e19-ea6d-4ce3-adb5-3b4b9e5369b1 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.174569 May 10 14:07:22.581512 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 510/995] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:22 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:23.597349 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-61d3f5b9-aaba-468b-a685-2c053206beb5 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:23.597989 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-61d3f5b9-aaba-468b-a685-2c053206beb5 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:23.604358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-61d3f5b9-aaba-468b-a685-2c053206beb5 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:23.604808 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-61d3f5b9-aaba-468b-a685-2c053206beb5 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:23.605573 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-61d3f5b9-aaba-468b-a685-2c053206beb5 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:23.606008 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-61d3f5b9-aaba-468b-a685-2c053206beb5 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:23.738819 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-61d3f5b9-aaba-468b-a685-2c053206beb5 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:23.746029 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-61d3f5b9-aaba-468b-a685-2c053206beb5 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.152579 May 10 14:07:23.746595 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 486/996] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:23 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:24.762842 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-6770b137-4083-4f1e-b919-16a211c67a0a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:24.763485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-6770b137-4083-4f1e-b919-16a211c67a0a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:24.769915 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6770b137-4083-4f1e-b919-16a211c67a0a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:24.770365 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6770b137-4083-4f1e-b919-16a211c67a0a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:24.771134 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6770b137-4083-4f1e-b919-16a211c67a0a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:24.771577 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6770b137-4083-4f1e-b919-16a211c67a0a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:24.901636 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-6770b137-4083-4f1e-b919-16a211c67a0a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:24.910191 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-6770b137-4083-4f1e-b919-16a211c67a0a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.151170 May 10 14:07:24.910900 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 511/997] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:24 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:25.927383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ed910685-65cd-45eb-a439-99caeee7f9c7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:25.927998 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ed910685-65cd-45eb-a439-99caeee7f9c7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:25.934592 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ed910685-65cd-45eb-a439-99caeee7f9c7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:25.935233 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ed910685-65cd-45eb-a439-99caeee7f9c7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:25.936281 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ed910685-65cd-45eb-a439-99caeee7f9c7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:25.936828 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ed910685-65cd-45eb-a439-99caeee7f9c7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:26.068814 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ed910685-65cd-45eb-a439-99caeee7f9c7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:26.076068 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ed910685-65cd-45eb-a439-99caeee7f9c7 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.152818 May 10 14:07:26.076750 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 487/998] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:25 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:27.092691 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-af3131c5-0131-45de-a856-eb2ed3c6592f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:27.093316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-af3131c5-0131-45de-a856-eb2ed3c6592f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:27.099685 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-af3131c5-0131-45de-a856-eb2ed3c6592f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:27.100145 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-af3131c5-0131-45de-a856-eb2ed3c6592f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:27.101016 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-af3131c5-0131-45de-a856-eb2ed3c6592f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:27.101458 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-af3131c5-0131-45de-a856-eb2ed3c6592f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:27.257799 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-af3131c5-0131-45de-a856-eb2ed3c6592f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:27.265129 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-af3131c5-0131-45de-a856-eb2ed3c6592f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.176268 May 10 14:07:27.265707 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 512/999] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:27 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:28.285649 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-ac99c7ee-f457-4f29-9eb1-1141247773fc tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:28.287045 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-ac99c7ee-f457-4f29-9eb1-1141247773fc tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:28.294236 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ac99c7ee-f457-4f29-9eb1-1141247773fc tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:28.294984 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ac99c7ee-f457-4f29-9eb1-1141247773fc tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:28.296031 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ac99c7ee-f457-4f29-9eb1-1141247773fc tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:28.296505 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-ac99c7ee-f457-4f29-9eb1-1141247773fc tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:28.429800 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-ac99c7ee-f457-4f29-9eb1-1141247773fc tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:28.437672 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-ac99c7ee-f457-4f29-9eb1-1141247773fc tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.156131 May 10 14:07:28.438370 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 488/1000] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:28 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:29.455034 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-b44a0524-7688-4612-a022-032f8f5efd16 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:29.455652 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-b44a0524-7688-4612-a022-032f8f5efd16 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:29.462105 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b44a0524-7688-4612-a022-032f8f5efd16 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:29.462558 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b44a0524-7688-4612-a022-032f8f5efd16 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:29.463335 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b44a0524-7688-4612-a022-032f8f5efd16 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:29.463779 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-b44a0524-7688-4612-a022-032f8f5efd16 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:29.592503 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-b44a0524-7688-4612-a022-032f8f5efd16 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:29.600303 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-b44a0524-7688-4612-a022-032f8f5efd16 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.149261 May 10 14:07:29.600879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 513/1001] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:29 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:30.618190 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c15ab9fd-23f9-463f-b517-50675ae5cb6a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:30.618797 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c15ab9fd-23f9-463f-b517-50675ae5cb6a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:30.625493 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c15ab9fd-23f9-463f-b517-50675ae5cb6a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:30.625942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c15ab9fd-23f9-463f-b517-50675ae5cb6a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:30.626706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c15ab9fd-23f9-463f-b517-50675ae5cb6a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:30.627142 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c15ab9fd-23f9-463f-b517-50675ae5cb6a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:30.757691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c15ab9fd-23f9-463f-b517-50675ae5cb6a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:30.766131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c15ab9fd-23f9-463f-b517-50675ae5cb6a tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.151665 May 10 14:07:30.766992 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 489/1002] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:30 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:31.782786 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-27002da1-afc9-48f4-8651-a2db52e9a7e9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:31.783400 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-27002da1-afc9-48f4-8651-a2db52e9a7e9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:31.790211 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-27002da1-afc9-48f4-8651-a2db52e9a7e9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:31.790654 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-27002da1-afc9-48f4-8651-a2db52e9a7e9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:31.791428 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-27002da1-afc9-48f4-8651-a2db52e9a7e9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:31.791875 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-27002da1-afc9-48f4-8651-a2db52e9a7e9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:31.926105 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-27002da1-afc9-48f4-8651-a2db52e9a7e9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:31.933577 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-27002da1-afc9-48f4-8651-a2db52e9a7e9 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.154773 May 10 14:07:31.934154 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 514/1003] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:31 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:32.950100 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4f1861d9-f991-4d7a-a31f-b1a5191ebf25 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:32.950704 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4f1861d9-f991-4d7a-a31f-b1a5191ebf25 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:32.957546 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4f1861d9-f991-4d7a-a31f-b1a5191ebf25 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:32.957994 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4f1861d9-f991-4d7a-a31f-b1a5191ebf25 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:32.958750 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4f1861d9-f991-4d7a-a31f-b1a5191ebf25 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:32.959179 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4f1861d9-f991-4d7a-a31f-b1a5191ebf25 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:33.096131 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4f1861d9-f991-4d7a-a31f-b1a5191ebf25 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:33.103431 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4f1861d9-f991-4d7a-a31f-b1a5191ebf25 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.157155 May 10 14:07:33.104001 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 490/1004] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:32 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:34.121020 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-875b18de-ca90-456e-9d0b-528728c22012 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:34.121020 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-875b18de-ca90-456e-9d0b-528728c22012 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:34.128876 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-875b18de-ca90-456e-9d0b-528728c22012 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:34.129485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-875b18de-ca90-456e-9d0b-528728c22012 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:34.130572 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-875b18de-ca90-456e-9d0b-528728c22012 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:34.131106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-875b18de-ca90-456e-9d0b-528728c22012 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:34.284193 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-875b18de-ca90-456e-9d0b-528728c22012 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:34.292903 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-875b18de-ca90-456e-9d0b-528728c22012 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.176515 May 10 14:07:34.293622 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 515/1005] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:34 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:07:35.310764 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-77e4d9e9-1a24-464f-9e79-8acbe95d1c41 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:35.311554 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-77e4d9e9-1a24-464f-9e79-8acbe95d1c41 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:35.318338 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-77e4d9e9-1a24-464f-9e79-8acbe95d1c41 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:35.318781 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-77e4d9e9-1a24-464f-9e79-8acbe95d1c41 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:35.319544 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-77e4d9e9-1a24-464f-9e79-8acbe95d1c41 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:35.319974 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-77e4d9e9-1a24-464f-9e79-8acbe95d1c41 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:35.453511 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-77e4d9e9-1a24-464f-9e79-8acbe95d1c41 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:35.461407 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-77e4d9e9-1a24-464f-9e79-8acbe95d1c41 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.154444 May 10 14:07:35.462074 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 491/1006] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:35 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:35.772367 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-0aaecf24-8d99-4be0-a53d-ebe6abcc96ec req-345c1f4b-ff20-4ef6-a32f-a09c061c2add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69343f84-e94e-4334-b040-ab048b6795ac", "name": "network-vif-plugged", "status": "completed", "tag": "6daf67e0-ce03-4c62-acf8-42fa18634144"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:35.783266 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-0aaecf24-8d99-4be0-a53d-ebe6abcc96ec req-345c1f4b-ff20-4ef6-a32f-a09c061c2add service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:35.783904 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-0aaecf24-8d99-4be0-a53d-ebe6abcc96ec req-345c1f4b-ff20-4ef6-a32f-a09c061c2add service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:35.799384 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-0aaecf24-8d99-4be0-a53d-ebe6abcc96ec req-345c1f4b-ff20-4ef6-a32f-a09c061c2add service nova] Creating event network-vif-plugged:6daf67e0-ce03-4c62-acf8-42fa18634144 for instance 69343f84-e94e-4334-b040-ab048b6795ac on hv-cinder-84067 May 10 14:07:35.806039 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-0aaecf24-8d99-4be0-a53d-ebe6abcc96ec req-345c1f4b-ff20-4ef6-a32f-a09c061c2add service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037087 May 10 14:07:35.807251 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 516/1007] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:07:36.478338 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bd8947a0-4976-4af3-8649-1a0ccb2ddf34 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:36.478949 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bd8947a0-4976-4af3-8649-1a0ccb2ddf34 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:36.485224 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bd8947a0-4976-4af3-8649-1a0ccb2ddf34 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:36.485671 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bd8947a0-4976-4af3-8649-1a0ccb2ddf34 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:36.486444 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bd8947a0-4976-4af3-8649-1a0ccb2ddf34 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:36.486880 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bd8947a0-4976-4af3-8649-1a0ccb2ddf34 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:36.625333 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bd8947a0-4976-4af3-8649-1a0ccb2ddf34 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:36.632914 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bd8947a0-4976-4af3-8649-1a0ccb2ddf34 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1265 microversion: 2.1 time: 0.158383 May 10 14:07:36.633496 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 492/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:36 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:37.651604 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-bab619f6-0d22-4d12-8c70-eb4bd337bb5c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:37.652352 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-bab619f6-0d22-4d12-8c70-eb4bd337bb5c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:37.658598 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bab619f6-0d22-4d12-8c70-eb4bd337bb5c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:37.659072 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bab619f6-0d22-4d12-8c70-eb4bd337bb5c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:37.659839 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bab619f6-0d22-4d12-8c70-eb4bd337bb5c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:37.660302 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-bab619f6-0d22-4d12-8c70-eb4bd337bb5c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:37.790859 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-bab619f6-0d22-4d12-8c70-eb4bd337bb5c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:37.798178 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-bab619f6-0d22-4d12-8c70-eb4bd337bb5c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1451 microversion: 2.1 time: 0.151312 May 10 14:07:37.798749 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 517/1009] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:37 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:37.813727 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c2b9dc83-dd3a-4f14-b244-a9d2f370244c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:37.814330 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c2b9dc83-dd3a-4f14-b244-a9d2f370244c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:37.821047 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c2b9dc83-dd3a-4f14-b244-a9d2f370244c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:37.821492 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c2b9dc83-dd3a-4f14-b244-a9d2f370244c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:37.822285 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c2b9dc83-dd3a-4f14-b244-a9d2f370244c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:37.822717 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c2b9dc83-dd3a-4f14-b244-a9d2f370244c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:37.948020 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c2b9dc83-dd3a-4f14-b244-a9d2f370244c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:37.955469 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c2b9dc83-dd3a-4f14-b244-a9d2f370244c tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1451 microversion: 2.1 time: 0.145463 May 10 14:07:37.956045 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 493/1010] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:37 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:39.938812 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-7753d002-3fe8-4fca-827e-d3d701e04819 req-3dc67a41-2d10-44c3-a146-752d01d7f567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69343f84-e94e-4334-b040-ab048b6795ac", "tag": "6daf67e0-ce03-4c62-acf8-42fa18634144"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:39.947247 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-7753d002-3fe8-4fca-827e-d3d701e04819 req-3dc67a41-2d10-44c3-a146-752d01d7f567 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:39.947695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-7753d002-3fe8-4fca-827e-d3d701e04819 req-3dc67a41-2d10-44c3-a146-752d01d7f567 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:39.959150 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-7753d002-3fe8-4fca-827e-d3d701e04819 req-3dc67a41-2d10-44c3-a146-752d01d7f567 service nova] Creating event network-changed:6daf67e0-ce03-4c62-acf8-42fa18634144 for instance 69343f84-e94e-4334-b040-ab048b6795ac on hv-cinder-84067 May 10 14:07:39.964263 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-7753d002-3fe8-4fca-827e-d3d701e04819 req-3dc67a41-2d10-44c3-a146-752d01d7f567 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029837 May 10 14:07:39.964870 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 518/1011] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:45.176570 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-532309790", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "networks": [{"uuid": "5c735cb5-b8bc-42fa-b57c-d137ac3529b8"}]}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:45.227383 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.network.neutron [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] validate_networks() for [('5c735cb5-b8bc-42fa-b57c-d137ac3529b8', None, None, None, None, None)] {{(pid=117153) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:07:45.567506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Flavor limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:07:45.567934 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Image limits 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:07:45.568445 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Flavor pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:07:45.568857 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Image pref 0:0:0 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:07:45.569306 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.virt.hardware [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:07:45.577848 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:45.578299 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:45.579102 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:45.579542 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:45.596899 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Getting quotas for project a2a2e2e6222f48ebae4e9f9d7e9e8a4d. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:07:45.600728 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.quota [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Getting quotas for user 2afab5deb8c34f058c659a22a3402c59 and project a2a2e2e6222f48ebae4e9f9d7e9e8a4d. Resources: {'instances', 'ram', 'cores'} {{(pid=117153) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:07:45.611349 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Going to run 1 instances... {{(pid=117153) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:07:45.613614 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:07:45.659446 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-def32a10-c871-47a9-9a54-b94d6bb8e99e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486823 May 10 14:07:45.660096 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 494/1012] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:07:45.675986 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a5713828-88e0-4523-b2cf-ee90d9422ce3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:45.676719 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a5713828-88e0-4523-b2cf-ee90d9422ce3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:45.730326 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a5713828-88e0-4523-b2cf-ee90d9422ce3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:45.736911 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a5713828-88e0-4523-b2cf-ee90d9422ce3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1218 microversion: 2.1 time: 0.066652 May 10 14:07:45.737477 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 519/1013] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:45 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:46.754068 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-555574cf-c42e-4602-99bc-4a036622f8d7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:46.754680 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-555574cf-c42e-4602-99bc-4a036622f8d7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:46.761662 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-555574cf-c42e-4602-99bc-4a036622f8d7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:46.762114 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-555574cf-c42e-4602-99bc-4a036622f8d7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:46.762886 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-555574cf-c42e-4602-99bc-4a036622f8d7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:46.763329 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-555574cf-c42e-4602-99bc-4a036622f8d7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:46.823408 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-555574cf-c42e-4602-99bc-4a036622f8d7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:46.831096 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-555574cf-c42e-4602-99bc-4a036622f8d7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1222 microversion: 2.1 time: 0.080406 May 10 14:07:46.831668 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 495/1014] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:46 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:47.846757 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-354585f6-3e22-4556-aab1-47690db9177e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:47.847365 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-354585f6-3e22-4556-aab1-47690db9177e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:47.854422 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-354585f6-3e22-4556-aab1-47690db9177e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:47.854872 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-354585f6-3e22-4556-aab1-47690db9177e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:47.855647 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-354585f6-3e22-4556-aab1-47690db9177e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:47.856086 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-354585f6-3e22-4556-aab1-47690db9177e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:47.918239 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-354585f6-3e22-4556-aab1-47690db9177e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:47.926228 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-354585f6-3e22-4556-aab1-47690db9177e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1270 microversion: 2.1 time: 0.083318 May 10 14:07:47.926806 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 520/1015] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:47 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:48.943555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a2ae6d9a-395c-4856-88a2-6a18ff4c2adb tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:48.944457 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a2ae6d9a-395c-4856-88a2-6a18ff4c2adb tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:48.951108 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a2ae6d9a-395c-4856-88a2-6a18ff4c2adb tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:48.951566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a2ae6d9a-395c-4856-88a2-6a18ff4c2adb tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:48.952387 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a2ae6d9a-395c-4856-88a2-6a18ff4c2adb tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:48.952831 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a2ae6d9a-395c-4856-88a2-6a18ff4c2adb tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:49.168884 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a2ae6d9a-395c-4856-88a2-6a18ff4c2adb tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:49.176673 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a2ae6d9a-395c-4856-88a2-6a18ff4c2adb tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.237611 May 10 14:07:49.177183 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 496/1016] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:48 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:07:49.669933 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-35608d80-e18e-4b31-a8de-a20e37af559f req-5f96ec2b-42bb-4f6e-ad79-4b955a23cb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31c2003-362c-4c41-814f-0dd48e4491c6", "tag": "e43674f4-dd4d-41cb-9f1a-5b021cf0edab"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:49.680936 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-35608d80-e18e-4b31-a8de-a20e37af559f req-5f96ec2b-42bb-4f6e-ad79-4b955a23cb31 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:49.681392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-35608d80-e18e-4b31-a8de-a20e37af559f req-5f96ec2b-42bb-4f6e-ad79-4b955a23cb31 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:49.694338 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-35608d80-e18e-4b31-a8de-a20e37af559f req-5f96ec2b-42bb-4f6e-ad79-4b955a23cb31 service nova] Creating event network-changed:e43674f4-dd4d-41cb-9f1a-5b021cf0edab for instance b31c2003-362c-4c41-814f-0dd48e4491c6 on hv-cinder-84067 May 10 14:07:49.699416 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-35608d80-e18e-4b31-a8de-a20e37af559f req-5f96ec2b-42bb-4f6e-ad79-4b955a23cb31 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033869 May 10 14:07:49.700023 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 521/1017] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:50.200542 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-be3ff5f4-5633-436f-acd8-18a88ebe377a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:50.200542 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-be3ff5f4-5633-436f-acd8-18a88ebe377a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:50.206776 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-be3ff5f4-5633-436f-acd8-18a88ebe377a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:50.207230 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-be3ff5f4-5633-436f-acd8-18a88ebe377a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:50.208017 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-be3ff5f4-5633-436f-acd8-18a88ebe377a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:50.208509 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-be3ff5f4-5633-436f-acd8-18a88ebe377a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:50.341770 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-be3ff5f4-5633-436f-acd8-18a88ebe377a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:50.350737 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-be3ff5f4-5633-436f-acd8-18a88ebe377a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.160635 May 10 14:07:50.351370 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 497/1018] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:50 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:51.368407 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f3c9ecb6-c98c-4782-9f4d-d56d7a722c49 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:51.369149 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f3c9ecb6-c98c-4782-9f4d-d56d7a722c49 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:51.375525 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f3c9ecb6-c98c-4782-9f4d-d56d7a722c49 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:51.375985 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f3c9ecb6-c98c-4782-9f4d-d56d7a722c49 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:51.376795 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f3c9ecb6-c98c-4782-9f4d-d56d7a722c49 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:51.377800 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f3c9ecb6-c98c-4782-9f4d-d56d7a722c49 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:51.511968 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f3c9ecb6-c98c-4782-9f4d-d56d7a722c49 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:51.519370 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f3c9ecb6-c98c-4782-9f4d-d56d7a722c49 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.155839 May 10 14:07:51.519944 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 522/1019] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:51 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:52.536340 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bbdc768e-93c0-4073-a799-9347654cfec0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:52.536960 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bbdc768e-93c0-4073-a799-9347654cfec0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:52.543205 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbdc768e-93c0-4073-a799-9347654cfec0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:52.543664 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbdc768e-93c0-4073-a799-9347654cfec0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:52.544466 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbdc768e-93c0-4073-a799-9347654cfec0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:52.545044 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bbdc768e-93c0-4073-a799-9347654cfec0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:52.680017 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bbdc768e-93c0-4073-a799-9347654cfec0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:52.687457 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bbdc768e-93c0-4073-a799-9347654cfec0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.155428 May 10 14:07:52.688295 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 498/1020] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:52 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:53.704371 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ceac470f-bcb4-4c11-ac5a-0e7126616869 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:53.704977 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ceac470f-bcb4-4c11-ac5a-0e7126616869 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:53.711409 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ceac470f-bcb4-4c11-ac5a-0e7126616869 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:53.711920 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ceac470f-bcb4-4c11-ac5a-0e7126616869 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:53.713052 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ceac470f-bcb4-4c11-ac5a-0e7126616869 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:53.713493 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ceac470f-bcb4-4c11-ac5a-0e7126616869 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:53.866309 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ceac470f-bcb4-4c11-ac5a-0e7126616869 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:53.875461 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ceac470f-bcb4-4c11-ac5a-0e7126616869 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.175071 May 10 14:07:53.876624 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 523/1021] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:53 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:54.893026 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-794c9994-8694-4576-a1e9-4b31bf799db5 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:54.893811 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-794c9994-8694-4576-a1e9-4b31bf799db5 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:54.900666 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-794c9994-8694-4576-a1e9-4b31bf799db5 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:54.901115 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-794c9994-8694-4576-a1e9-4b31bf799db5 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:54.901966 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-794c9994-8694-4576-a1e9-4b31bf799db5 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:54.902509 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-794c9994-8694-4576-a1e9-4b31bf799db5 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:55.027353 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-794c9994-8694-4576-a1e9-4b31bf799db5 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:55.034962 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-794c9994-8694-4576-a1e9-4b31bf799db5 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.146737 May 10 14:07:55.035859 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 499/1022] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:54 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:07:56.052457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-17666e75-08b1-487e-8082-0412f4445df3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:56.053003 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-17666e75-08b1-487e-8082-0412f4445df3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:56.059374 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-17666e75-08b1-487e-8082-0412f4445df3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:56.059830 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-17666e75-08b1-487e-8082-0412f4445df3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:56.060638 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-17666e75-08b1-487e-8082-0412f4445df3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:56.061087 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-17666e75-08b1-487e-8082-0412f4445df3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:56.193260 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-17666e75-08b1-487e-8082-0412f4445df3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:56.200388 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-17666e75-08b1-487e-8082-0412f4445df3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.151908 May 10 14:07:56.200937 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 524/1023] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:56 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:57.217591 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8ab1a83a-f0f7-45b8-9012-7de0a0e90061 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:57.218149 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8ab1a83a-f0f7-45b8-9012-7de0a0e90061 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:57.224954 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8ab1a83a-f0f7-45b8-9012-7de0a0e90061 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:57.225414 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8ab1a83a-f0f7-45b8-9012-7de0a0e90061 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:57.226185 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8ab1a83a-f0f7-45b8-9012-7de0a0e90061 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:57.226625 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8ab1a83a-f0f7-45b8-9012-7de0a0e90061 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:57.356639 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-8ab1a83a-f0f7-45b8-9012-7de0a0e90061 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:57.364458 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8ab1a83a-f0f7-45b8-9012-7de0a0e90061 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.150768 May 10 14:07:57.365026 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 500/1024] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:57 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:58.381869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e495ec13-d206-4995-b844-5536a0ba9927 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:58.382500 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e495ec13-d206-4995-b844-5536a0ba9927 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:58.388947 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e495ec13-d206-4995-b844-5536a0ba9927 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:58.389404 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e495ec13-d206-4995-b844-5536a0ba9927 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:58.390184 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e495ec13-d206-4995-b844-5536a0ba9927 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:58.390628 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e495ec13-d206-4995-b844-5536a0ba9927 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:58.514551 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e495ec13-d206-4995-b844-5536a0ba9927 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:58.522163 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e495ec13-d206-4995-b844-5536a0ba9927 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.144923 May 10 14:07:58.522772 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 525/1025] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:58 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:59.538468 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5c59a4c7-c093-451a-8268-c82fcd9b424e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:59.539026 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-5c59a4c7-c093-451a-8268-c82fcd9b424e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:59.545261 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5c59a4c7-c093-451a-8268-c82fcd9b424e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:59.545711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5c59a4c7-c093-451a-8268-c82fcd9b424e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:59.546471 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5c59a4c7-c093-451a-8268-c82fcd9b424e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:59.546905 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5c59a4c7-c093-451a-8268-c82fcd9b424e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:59.671948 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-5c59a4c7-c093-451a-8268-c82fcd9b424e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:59.679193 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-5c59a4c7-c093-451a-8268-c82fcd9b424e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.145340 May 10 14:07:59.679757 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 501/1026] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:07:59 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:00.696698 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-82f1c2d0-9f5d-4610-9a90-74f6084ca680 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:00.697342 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-82f1c2d0-9f5d-4610-9a90-74f6084ca680 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:00.703643 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-82f1c2d0-9f5d-4610-9a90-74f6084ca680 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:00.704100 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-82f1c2d0-9f5d-4610-9a90-74f6084ca680 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:00.704916 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-82f1c2d0-9f5d-4610-9a90-74f6084ca680 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:00.705358 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-82f1c2d0-9f5d-4610-9a90-74f6084ca680 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:00.829394 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-82f1c2d0-9f5d-4610-9a90-74f6084ca680 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:00.836650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-82f1c2d0-9f5d-4610-9a90-74f6084ca680 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.144471 May 10 14:08:00.837228 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 526/1027] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:08:00 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:01.853991 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-55f04cc4-bbdc-46b8-9217-9bbbe66970b4 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:01.854599 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-55f04cc4-bbdc-46b8-9217-9bbbe66970b4 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:01.860978 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-55f04cc4-bbdc-46b8-9217-9bbbe66970b4 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:01.861425 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-55f04cc4-bbdc-46b8-9217-9bbbe66970b4 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:01.862188 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-55f04cc4-bbdc-46b8-9217-9bbbe66970b4 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:01.862628 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-55f04cc4-bbdc-46b8-9217-9bbbe66970b4 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:01.993015 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-55f04cc4-bbdc-46b8-9217-9bbbe66970b4 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:02.000066 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-55f04cc4-bbdc-46b8-9217-9bbbe66970b4 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.150002 May 10 14:08:02.000664 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 502/1028] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:08:01 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:02.598151 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-af0ffe98-8ab0-4e56-8a3e-617b6927b260 req-22719317-f916-40a1-aae4-49cf31301df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31c2003-362c-4c41-814f-0dd48e4491c6", "name": "network-vif-plugged", "status": "completed", "tag": "e43674f4-dd4d-41cb-9f1a-5b021cf0edab"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:02.607055 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-af0ffe98-8ab0-4e56-8a3e-617b6927b260 req-22719317-f916-40a1-aae4-49cf31301df0 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:02.607510 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-af0ffe98-8ab0-4e56-8a3e-617b6927b260 req-22719317-f916-40a1-aae4-49cf31301df0 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:02.618835 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-af0ffe98-8ab0-4e56-8a3e-617b6927b260 req-22719317-f916-40a1-aae4-49cf31301df0 service nova] Creating event network-vif-plugged:e43674f4-dd4d-41cb-9f1a-5b021cf0edab for instance b31c2003-362c-4c41-814f-0dd48e4491c6 on hv-cinder-84067 May 10 14:08:02.623721 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-af0ffe98-8ab0-4e56-8a3e-617b6927b260 req-22719317-f916-40a1-aae4-49cf31301df0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029275 May 10 14:08:02.624351 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 527/1029] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:03.016116 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9d5e95db-9725-4243-89e9-eb0e56eb1c09 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:03.016754 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9d5e95db-9725-4243-89e9-eb0e56eb1c09 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:03.023127 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9d5e95db-9725-4243-89e9-eb0e56eb1c09 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:03.023573 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9d5e95db-9725-4243-89e9-eb0e56eb1c09 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:03.024373 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9d5e95db-9725-4243-89e9-eb0e56eb1c09 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:03.024813 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9d5e95db-9725-4243-89e9-eb0e56eb1c09 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:03.149853 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9d5e95db-9725-4243-89e9-eb0e56eb1c09 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:03.157052 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9d5e95db-9725-4243-89e9-eb0e56eb1c09 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.145033 May 10 14:08:03.157611 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 503/1030] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:08:03 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:04.175271 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7a338d26-1438-4325-8ffc-434a3902766a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:04.175984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7a338d26-1438-4325-8ffc-434a3902766a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:04.182174 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7a338d26-1438-4325-8ffc-434a3902766a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:04.182627 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7a338d26-1438-4325-8ffc-434a3902766a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:04.183393 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7a338d26-1438-4325-8ffc-434a3902766a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:04.183836 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7a338d26-1438-4325-8ffc-434a3902766a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:04.310511 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7a338d26-1438-4325-8ffc-434a3902766a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:04.317957 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7a338d26-1438-4325-8ffc-434a3902766a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.147352 May 10 14:08:04.318911 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 528/1031] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:08:04 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:05.335449 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f9251ee2-0bb7-495d-8ecd-1f8947f190cf tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:05.336089 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f9251ee2-0bb7-495d-8ecd-1f8947f190cf tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:05.342418 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9251ee2-0bb7-495d-8ecd-1f8947f190cf tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:05.342871 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9251ee2-0bb7-495d-8ecd-1f8947f190cf tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:05.343646 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9251ee2-0bb7-495d-8ecd-1f8947f190cf tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:05.344092 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9251ee2-0bb7-495d-8ecd-1f8947f190cf tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:05.469201 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f9251ee2-0bb7-495d-8ecd-1f8947f190cf tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:05.476308 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f9251ee2-0bb7-495d-8ecd-1f8947f190cf tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.145481 May 10 14:08:05.476878 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 504/1032] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:08:05 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:06.493489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a9cb5d84-2ae0-4b93-90ca-f34c2055ff55 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:06.494106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a9cb5d84-2ae0-4b93-90ca-f34c2055ff55 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:06.500419 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a9cb5d84-2ae0-4b93-90ca-f34c2055ff55 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:06.500868 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a9cb5d84-2ae0-4b93-90ca-f34c2055ff55 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:06.501629 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a9cb5d84-2ae0-4b93-90ca-f34c2055ff55 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:06.502066 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a9cb5d84-2ae0-4b93-90ca-f34c2055ff55 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:06.709553 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a9cb5d84-2ae0-4b93-90ca-f34c2055ff55 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:06.717112 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a9cb5d84-2ae0-4b93-90ca-f34c2055ff55 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.228040 May 10 14:08:06.717740 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 529/1033] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:08:06 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:07.735865 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bb2fdc09-632e-499b-b545-375710c8a538 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:07.736507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bb2fdc09-632e-499b-b545-375710c8a538 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:07.745219 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bb2fdc09-632e-499b-b545-375710c8a538 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:07.745672 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bb2fdc09-632e-499b-b545-375710c8a538 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:07.746455 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bb2fdc09-632e-499b-b545-375710c8a538 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:07.746897 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bb2fdc09-632e-499b-b545-375710c8a538 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:07.912061 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bb2fdc09-632e-499b-b545-375710c8a538 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:07.916917 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bb2fdc09-632e-499b-b545-375710c8a538 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1318 microversion: 2.1 time: 0.186199 May 10 14:08:07.926290 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 505/1034] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:08:07 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:08.933755 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-04019e0d-4329-46ad-91b3-71146093d5d3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:08.934372 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-04019e0d-4329-46ad-91b3-71146093d5d3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:08.940705 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-04019e0d-4329-46ad-91b3-71146093d5d3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:08.941162 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-04019e0d-4329-46ad-91b3-71146093d5d3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:08.941936 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-04019e0d-4329-46ad-91b3-71146093d5d3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:08.943010 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-04019e0d-4329-46ad-91b3-71146093d5d3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:09.067869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-04019e0d-4329-46ad-91b3-71146093d5d3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:09.075225 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-04019e0d-4329-46ad-91b3-71146093d5d3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1508 microversion: 2.1 time: 0.145350 May 10 14:08:09.075802 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 530/1035] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:08:08 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:08:32.627928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2bc0078e-867f-499e-b9dd-a0ae5c9146ea tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b1f34de-0675-45b3-8293-e61f9a52c592", "device": "/dev/sdb"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:32.629576 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2bc0078e-867f-499e-b9dd-a0ae5c9146ea tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:32.636102 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2bc0078e-867f-499e-b9dd-a0ae5c9146ea tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:32.636587 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2bc0078e-867f-499e-b9dd-a0ae5c9146ea tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:32.637359 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2bc0078e-867f-499e-b9dd-a0ae5c9146ea tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:32.637800 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2bc0078e-867f-499e-b9dd-a0ae5c9146ea tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:36.029617 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2bc0078e-867f-499e-b9dd-a0ae5c9146ea tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "POST /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.405483 May 10 14:08:36.030244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 506/1036] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:08:32 2022] POST /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6/os-volume_attachments => generated 194 bytes in 3407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:01.809888 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a596817d-2d84-4956-af74-fbe355d048f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:01.810517 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a596817d-2d84-4956-af74-fbe355d048f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:01.816831 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a596817d-2d84-4956-af74-fbe355d048f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:01.817435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a596817d-2d84-4956-af74-fbe355d048f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:01.818351 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a596817d-2d84-4956-af74-fbe355d048f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:01.818900 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a596817d-2d84-4956-af74-fbe355d048f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:01.915662 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.objects.instance [None req-a596817d-2d84-4956-af74-fbe355d048f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lazy-loading 'services' on Instance uuid b31c2003-362c-4c41-814f-0dd48e4491c6 {{(pid=117154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:09:02.007267 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a596817d-2d84-4956-af74-fbe355d048f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6/os-volume_attachments/0b1f34de-0675-45b3-8293-e61f9a52c592" status: 202 len: 0 microversion: 2.1 time: 0.201382 May 10 14:09:02.008147 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 531/1037] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 14:09:01 2022] DELETE /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6/os-volume_attachments/0b1f34de-0675-45b3-8293-e61f9a52c592 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:09:03.152193 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-d6819a1b-3318-45ea-ae90-bb6bc0d86b38 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:03.152792 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d6819a1b-3318-45ea-ae90-bb6bc0d86b38 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:03.159291 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d6819a1b-3318-45ea-ae90-bb6bc0d86b38 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:03.159743 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d6819a1b-3318-45ea-ae90-bb6bc0d86b38 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:03.160568 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d6819a1b-3318-45ea-ae90-bb6bc0d86b38 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:03.161011 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-d6819a1b-3318-45ea-ae90-bb6bc0d86b38 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:03.222761 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-d6819a1b-3318-45ea-ae90-bb6bc0d86b38 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Going to try to terminate instance {{(pid=117153) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:09:03.372887 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-d6819a1b-3318-45ea-ae90-bb6bc0d86b38 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 204 len: 0 microversion: 2.1 time: 0.223836 May 10 14:09:03.372887 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 507/1038] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:09:03 2022] DELETE /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:09:03.395780 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8427f8cc-ef6d-416c-9e5a-b7403c2130f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:03.396618 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8427f8cc-ef6d-416c-9e5a-b7403c2130f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:03.405158 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8427f8cc-ef6d-416c-9e5a-b7403c2130f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:03.405375 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8427f8cc-ef6d-416c-9e5a-b7403c2130f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:03.406143 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8427f8cc-ef6d-416c-9e5a-b7403c2130f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:03.406591 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8427f8cc-ef6d-416c-9e5a-b7403c2130f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:03.696490 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8427f8cc-ef6d-416c-9e5a-b7403c2130f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:03.708725 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8427f8cc-ef6d-416c-9e5a-b7403c2130f8 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1514 microversion: 2.1 time: 0.325666 May 10 14:09:03.709333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 532/1039] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:03 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1514 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:04.726832 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a56ae4b2-b8c2-4ff3-819b-029cff67628d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:04.727667 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a56ae4b2-b8c2-4ff3-819b-029cff67628d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:04.740136 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a56ae4b2-b8c2-4ff3-819b-029cff67628d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:04.740995 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a56ae4b2-b8c2-4ff3-819b-029cff67628d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:04.742019 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a56ae4b2-b8c2-4ff3-819b-029cff67628d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:04.742671 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a56ae4b2-b8c2-4ff3-819b-029cff67628d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:04.894190 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a56ae4b2-b8c2-4ff3-819b-029cff67628d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:04.903765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a56ae4b2-b8c2-4ff3-819b-029cff67628d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1514 microversion: 2.1 time: 0.180713 May 10 14:09:04.904377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 508/1040] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:04 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:05.658864 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-9634590d-de0c-4b50-b409-af35febec196 req-6a669685-d63f-40a2-adc3-763aa48893c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31c2003-362c-4c41-814f-0dd48e4491c6", "name": "network-vif-deleted", "tag": "e43674f4-dd4d-41cb-9f1a-5b021cf0edab"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:05.668685 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-9634590d-de0c-4b50-b409-af35febec196 req-6a669685-d63f-40a2-adc3-763aa48893c7 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:05.669125 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-9634590d-de0c-4b50-b409-af35febec196 req-6a669685-d63f-40a2-adc3-763aa48893c7 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:05.680979 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-9634590d-de0c-4b50-b409-af35febec196 req-6a669685-d63f-40a2-adc3-763aa48893c7 service nova] Creating event network-vif-deleted:e43674f4-dd4d-41cb-9f1a-5b021cf0edab for instance b31c2003-362c-4c41-814f-0dd48e4491c6 on hv-cinder-84067 May 10 14:09:05.686053 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-9634590d-de0c-4b50-b409-af35febec196 req-6a669685-d63f-40a2-adc3-763aa48893c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030924 May 10 14:09:05.687012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 533/1041] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:05.921886 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-e42e533b-dfb4-4000-a53a-f8d1367d341d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:05.922500 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-e42e533b-dfb4-4000-a53a-f8d1367d341d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:05.929278 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e42e533b-dfb4-4000-a53a-f8d1367d341d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:05.929925 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e42e533b-dfb4-4000-a53a-f8d1367d341d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:05.930723 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e42e533b-dfb4-4000-a53a-f8d1367d341d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:05.931682 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e42e533b-dfb4-4000-a53a-f8d1367d341d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:05.972050 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e42e533b-dfb4-4000-a53a-f8d1367d341d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:05.972555 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-e42e533b-dfb4-4000-a53a-f8d1367d341d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:05.973017 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-e42e533b-dfb4-4000-a53a-f8d1367d341d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lazy-loading 'fault' on Instance uuid b31c2003-362c-4c41-814f-0dd48e4491c6 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:09:06.031112 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-e42e533b-dfb4-4000-a53a-f8d1367d341d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:06.039122 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-e42e533b-dfb4-4000-a53a-f8d1367d341d tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 200 len: 1308 microversion: 2.1 time: 0.121027 May 10 14:09:06.040398 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 509/1042] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:05 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 1308 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:06.588890 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9e27d073-212a-459f-b31d-a28bb6fcb52e tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Action: 'create', calling method: .version_select at 0x7f5f76776700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1970214200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYwOIPxOUe/HRw4jT1GZDhS4mcu2ZUg9oLrU2zepRcg3E2bwRQQ31IVJhUpKfH5scIu0Gqafz6aZ4409KKMhBAlEunQ7CkXTP+YaUUcrZ7fTqL92fd8g+IScIi1DdCafQ=="}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:06.603416 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-9e27d073-212a-459f-b31d-a28bb6fcb52e tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Getting quotas for project 5534e7deeddb4f72b5e068060f617c76. Resources: {'key_pairs'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:09:06.607256 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-9e27d073-212a-459f-b31d-a28bb6fcb52e tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Getting quotas for user eeb63f41f4b94ac29c82b334773ca9f8 and project 5534e7deeddb4f72b5e068060f617c76. Resources: {'key_pairs'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:09:06.629515 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9e27d073-212a-459f-b31d-a28bb6fcb52e tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.205811 May 10 14:09:06.630164 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 534/1043] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 14:09:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:07.056289 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-82cf6263-267c-4f9d-9e8c-81dadd4bfb20 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:07.056909 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-82cf6263-267c-4f9d-9e8c-81dadd4bfb20 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: b31c2003-362c-4c41-814f-0dd48e4491c6] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:07.063428 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82cf6263-267c-4f9d-9e8c-81dadd4bfb20 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:07.063881 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82cf6263-267c-4f9d-9e8c-81dadd4bfb20 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:07.064685 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82cf6263-267c-4f9d-9e8c-81dadd4bfb20 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:07.065205 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-82cf6263-267c-4f9d-9e8c-81dadd4bfb20 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:07.078974 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-82cf6263-267c-4f9d-9e8c-81dadd4bfb20 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] HTTP exception thrown: Instance b31c2003-362c-4c41-814f-0dd48e4491c6 could not be found. May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-82cf6263-267c-4f9d-9e8c-81dadd4bfb20 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Request method failure captured: May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 HTTP/1.1 May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABienGtIOq-wUYz9ohuVjIerh32jr3rmwniMQwvd04mPpvk5MC9g0jgcC1clcGfyiuURpUXmwJ5c3DQidl58G96wLoA8W1XZap4XZYWofBpk6p2d2NUAqJ93T2C8i96tXj3LYOsLRplmHeTs7V9kHd6-Ju3WNifZTRb42uk1awDuINwW9I May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: a2a2e2e6222f48ebae4e9f9d7e9e8a4d May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1742444496 May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:09:07.080653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:09:07.082227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2a2e2e6222f48ebae4e9f9d7e9e8a4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2a2e2e6222f48ebae4e9f9d7e9e8a4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2a2e2e6222f48ebae4e9f9d7e9e8a4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2a2e2e6222f48ebae4e9f9d7e9e8a4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:09:07.082227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-VolumesSnapshotTestJSON-1742444496 May 10 14:09:07.082227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: a2a2e2e6222f48ebae4e9f9d7e9e8a4d May 10 14:09:07.082227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1742444496 May 10 14:09:07.082227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-VolumesSnapshotTestJSON-1742444496-project May 10 14:09:07.082227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:09:07.082227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:09:07.082227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 2afab5deb8c34f058c659a22a3402c59 May 10 14:09:07.082227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-VolumesSnapshotTestJSON-1742444496-project May 10 14:09:07.082227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:09:07.082227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance b31c2003-362c-4c41-814f-0dd48e4491c6 could not be found. May 10 14:09:07.082227 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': 'b31c2003-362c-4c41-814f-0dd48e4491c6'} May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31c2003-362c-4c41-814f-0dd48e4491c6 could not be found. May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:07.083145 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31c2003-362c-4c41-814f-0dd48e4491c6 could not be found. May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31c2003-362c-4c41-814f-0dd48e4491c6 could not be found. May 10 14:09:07.084725 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:07.085934 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-82cf6263-267c-4f9d-9e8c-81dadd4bfb20 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Returning 404 to user: Instance b31c2003-362c-4c41-814f-0dd48e4491c6 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:07.085934 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-82cf6263-267c-4f9d-9e8c-81dadd4bfb20 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6" status: 404 len: 111 microversion: 2.1 time: 0.029833 May 10 14:09:07.085934 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 510/1044] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:07 2022] GET /compute/v2.1/servers/b31c2003-362c-4c41-814f-0dd48e4491c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:09:17.002994 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1068322667", "imageRef": "628ab293-eeff-4992-aeb4-50969b674311", "flavorRef": "452", "networks": [{"uuid": "5c735cb5-b8bc-42fa-b57c-d137ac3529b8"}]}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:17.054111 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] validate_networks() for [('5c735cb5-b8bc-42fa-b57c-d137ac3529b8', None, None, None, None, None)] {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:09:17.392630 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:09:17.393120 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:09:17.393539 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:09:17.393951 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:09:17.394365 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:09:17.403044 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:17.403491 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:17.404551 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:17.404985 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:17.421349 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Getting quotas for project a2a2e2e6222f48ebae4e9f9d7e9e8a4d. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:09:17.425208 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Getting quotas for user 2afab5deb8c34f058c659a22a3402c59 and project a2a2e2e6222f48ebae4e9f9d7e9e8a4d. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:09:17.437292 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:09:17.439664 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='628ab293-eeff-4992-aeb4-50969b674311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:09:17.484434 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0e39c0af-5fa0-4b2b-87a4-8d83f33d2db6 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485748 May 10 14:09:17.485122 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 535/1045] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:09:17.495052 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-72d8bcd0-2c6f-4ed0-ac83-6a3441f3eb7e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:17.496458 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-72d8bcd0-2c6f-4ed0-ac83-6a3441f3eb7e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:17.555512 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-72d8bcd0-2c6f-4ed0-ac83-6a3441f3eb7e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:17.562775 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-72d8bcd0-2c6f-4ed0-ac83-6a3441f3eb7e tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1219 microversion: 2.1 time: 0.071480 May 10 14:09:17.563351 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 511/1046] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:17 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:18.584893 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-81ed2ba3-d733-4d1c-90e8-90ae24095486 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:18.586238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-81ed2ba3-d733-4d1c-90e8-90ae24095486 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:18.595942 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-81ed2ba3-d733-4d1c-90e8-90ae24095486 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:18.596549 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-81ed2ba3-d733-4d1c-90e8-90ae24095486 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:18.597394 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-81ed2ba3-d733-4d1c-90e8-90ae24095486 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:18.597898 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-81ed2ba3-d733-4d1c-90e8-90ae24095486 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:18.687851 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-81ed2ba3-d733-4d1c-90e8-90ae24095486 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:18.695347 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-81ed2ba3-d733-4d1c-90e8-90ae24095486 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1289 microversion: 2.1 time: 0.114971 May 10 14:09:18.695916 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 536/1047] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:18 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1289 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:19.713303 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0d0f84e3-fa9d-47b7-b558-1166e815e0e3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:19.713928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0d0f84e3-fa9d-47b7-b558-1166e815e0e3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:19.723623 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d0f84e3-fa9d-47b7-b558-1166e815e0e3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:19.724071 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d0f84e3-fa9d-47b7-b558-1166e815e0e3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:19.724867 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d0f84e3-fa9d-47b7-b558-1166e815e0e3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:19.725301 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d0f84e3-fa9d-47b7-b558-1166e815e0e3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:19.887503 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-f90f5100-3628-41d4-bcf3-9ca63ccdf279 req-e86e1733-e287-48c7-972a-82f90eff51f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ea8970-dc8e-45b8-8cf4-2e986ccd8564", "tag": "235f625c-dada-4f4d-9a4c-affc95ada567"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:19.904512 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-f90f5100-3628-41d4-bcf3-9ca63ccdf279 req-e86e1733-e287-48c7-972a-82f90eff51f8 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:19.905046 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-f90f5100-3628-41d4-bcf3-9ca63ccdf279 req-e86e1733-e287-48c7-972a-82f90eff51f8 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:19.919060 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-f90f5100-3628-41d4-bcf3-9ca63ccdf279 req-e86e1733-e287-48c7-972a-82f90eff51f8 service nova] Creating event network-changed:235f625c-dada-4f4d-9a4c-affc95ada567 for instance 04ea8970-dc8e-45b8-8cf4-2e986ccd8564 on hv-cinder-84067 May 10 14:09:19.924313 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-f90f5100-3628-41d4-bcf3-9ca63ccdf279 req-e86e1733-e287-48c7-972a-82f90eff51f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041356 May 10 14:09:19.925359 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 537/1048] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:09:19.929056 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0d0f84e3-fa9d-47b7-b558-1166e815e0e3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:19.937842 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0d0f84e3-fa9d-47b7-b558-1166e815e0e3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1319 microversion: 2.1 time: 0.228336 May 10 14:09:19.938493 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 512/1049] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:19 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:20.956312 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-91bf138c-dff4-4409-b9c4-821d425d5a8a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:20.956928 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-91bf138c-dff4-4409-b9c4-821d425d5a8a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:20.962986 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-91bf138c-dff4-4409-b9c4-821d425d5a8a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:20.963439 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-91bf138c-dff4-4409-b9c4-821d425d5a8a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:20.964230 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-91bf138c-dff4-4409-b9c4-821d425d5a8a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:20.964667 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-91bf138c-dff4-4409-b9c4-821d425d5a8a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:21.090157 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-91bf138c-dff4-4409-b9c4-821d425d5a8a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:21.097313 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-91bf138c-dff4-4409-b9c4-821d425d5a8a tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1319 microversion: 2.1 time: 0.145716 May 10 14:09:21.097887 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 538/1050] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:20 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:22.114494 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0794e494-ce62-4572-bfd1-2d04afabdb23 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:22.115102 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0794e494-ce62-4572-bfd1-2d04afabdb23 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:22.122042 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0794e494-ce62-4572-bfd1-2d04afabdb23 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:22.122490 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0794e494-ce62-4572-bfd1-2d04afabdb23 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:22.123259 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0794e494-ce62-4572-bfd1-2d04afabdb23 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:22.123694 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0794e494-ce62-4572-bfd1-2d04afabdb23 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:22.250930 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0794e494-ce62-4572-bfd1-2d04afabdb23 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:22.258116 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0794e494-ce62-4572-bfd1-2d04afabdb23 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1319 microversion: 2.1 time: 0.147477 May 10 14:09:22.258682 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 513/1051] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:22 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:23.274953 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ba9d872e-ef10-4b77-9707-339cc95a9e32 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:23.275567 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ba9d872e-ef10-4b77-9707-339cc95a9e32 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:23.282513 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ba9d872e-ef10-4b77-9707-339cc95a9e32 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:23.282961 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ba9d872e-ef10-4b77-9707-339cc95a9e32 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:23.283722 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ba9d872e-ef10-4b77-9707-339cc95a9e32 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:23.284159 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ba9d872e-ef10-4b77-9707-339cc95a9e32 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:23.409024 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ba9d872e-ef10-4b77-9707-339cc95a9e32 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:23.416228 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ba9d872e-ef10-4b77-9707-339cc95a9e32 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1319 microversion: 2.1 time: 0.145311 May 10 14:09:23.416790 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 539/1052] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:23 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:24.432718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2e600ceb-60c1-46d3-a941-03234222548c tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:24.433985 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2e600ceb-60c1-46d3-a941-03234222548c tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:24.440313 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2e600ceb-60c1-46d3-a941-03234222548c tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:24.440765 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2e600ceb-60c1-46d3-a941-03234222548c tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:24.441539 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2e600ceb-60c1-46d3-a941-03234222548c tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:24.442007 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2e600ceb-60c1-46d3-a941-03234222548c tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:24.575378 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2e600ceb-60c1-46d3-a941-03234222548c tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:24.582639 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2e600ceb-60c1-46d3-a941-03234222548c tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1319 microversion: 2.1 time: 0.153804 May 10 14:09:24.583217 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 514/1053] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:24 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:24.868636 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-70509693", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1970214200", "security_groups": [{"name": "tempest-secgroup-smoke-982195854"}], "networks": [{"uuid": "c82a2923-712e-41ee-8597-e48c8815a404"}], "block_device_mapping_v2": [{"uuid": "c72411bb-a816-4843-b000-b2df8cc1a0d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:25.002207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.network.neutron [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] validate_networks() for [('c82a2923-712e-41ee-8597-e48c8815a404', None, None, None, None, None)] {{(pid=117154) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:09:25.375895 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Flavor limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:09:25.376346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Image limits 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:09:25.376847 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Flavor pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:09:25.377306 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Image pref 0:0:0 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:09:25.377716 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.virt.hardware [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:09:25.386253 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:25.386759 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:25.387477 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:25.387905 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:25.404659 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Getting quotas for project 5534e7deeddb4f72b5e068060f617c76. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:09:25.408572 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.quota [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Getting quotas for user eeb63f41f4b94ac29c82b334773ca9f8 and project 5534e7deeddb4f72b5e068060f617c76. Resources: {'instances', 'ram', 'cores'} {{(pid=117154) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:09:25.465171 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Going to run 1 instances... {{(pid=117154) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:09:25.467232 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c72411bb-a816-4843-b000-b2df8cc1a0d2',volume_size=None,volume_type=None)] {{(pid=117154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:09:25.592485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c611a99a-9a0c-4d45-a5d4-44c4a892215b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727749 May 10 14:09:25.593152 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 540/1054] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 14:09:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 14:09:25.600556 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2f5e483d-c15d-41f3-91f1-329dc935ab33 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:25.601735 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2f5e483d-c15d-41f3-91f1-329dc935ab33 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:25.602733 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1a8e941c-c836-427d-b3c7-276528089668 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:25.603378 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1a8e941c-c836-427d-b3c7-276528089668 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:25.610178 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2f5e483d-c15d-41f3-91f1-329dc935ab33 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:25.611065 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2f5e483d-c15d-41f3-91f1-329dc935ab33 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:25.611874 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2f5e483d-c15d-41f3-91f1-329dc935ab33 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:25.612415 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2f5e483d-c15d-41f3-91f1-329dc935ab33 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:25.667942 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1a8e941c-c836-427d-b3c7-276528089668 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:25.675664 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1a8e941c-c836-427d-b3c7-276528089668 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1087 microversion: 2.1 time: 0.075852 May 10 14:09:25.676289 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 541/1055] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:25 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:25.753853 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2f5e483d-c15d-41f3-91f1-329dc935ab33 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:25.763159 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2f5e483d-c15d-41f3-91f1-329dc935ab33 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1319 microversion: 2.1 time: 0.166423 May 10 14:09:25.763729 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 515/1056] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:25 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:26.509303 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-053f101d-8a5e-493c-80af-06dd2069e790 req-3a2b8ce0-0f17-40cc-be8a-bdacc6ac22ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ea8970-dc8e-45b8-8cf4-2e986ccd8564", "name": "network-vif-plugged", "status": "completed", "tag": "235f625c-dada-4f4d-9a4c-affc95ada567"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:26.519749 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-053f101d-8a5e-493c-80af-06dd2069e790 req-3a2b8ce0-0f17-40cc-be8a-bdacc6ac22ab service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:26.520229 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-053f101d-8a5e-493c-80af-06dd2069e790 req-3a2b8ce0-0f17-40cc-be8a-bdacc6ac22ab service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:26.544865 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-053f101d-8a5e-493c-80af-06dd2069e790 req-3a2b8ce0-0f17-40cc-be8a-bdacc6ac22ab service nova] Creating event network-vif-plugged:235f625c-dada-4f4d-9a4c-affc95ada567 for instance 04ea8970-dc8e-45b8-8cf4-2e986ccd8564 on hv-cinder-84067 May 10 14:09:26.550932 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-053f101d-8a5e-493c-80af-06dd2069e790 req-3a2b8ce0-0f17-40cc-be8a-bdacc6ac22ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045470 May 10 14:09:26.553211 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 542/1057] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:26.694928 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-07b28864-89a9-4ca4-ac5f-ba0ad01abfb8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:26.695736 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-07b28864-89a9-4ca4-ac5f-ba0ad01abfb8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:26.703433 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-07b28864-89a9-4ca4-ac5f-ba0ad01abfb8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:26.704306 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-07b28864-89a9-4ca4-ac5f-ba0ad01abfb8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:26.706712 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-07b28864-89a9-4ca4-ac5f-ba0ad01abfb8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:26.707231 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-07b28864-89a9-4ca4-ac5f-ba0ad01abfb8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:26.782817 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8d1a0536-ba4a-48ef-854f-d3bba7dafed3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:26.783920 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8d1a0536-ba4a-48ef-854f-d3bba7dafed3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:26.794363 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-07b28864-89a9-4ca4-ac5f-ba0ad01abfb8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:26.798806 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8d1a0536-ba4a-48ef-854f-d3bba7dafed3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:26.799448 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8d1a0536-ba4a-48ef-854f-d3bba7dafed3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:26.800451 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8d1a0536-ba4a-48ef-854f-d3bba7dafed3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:26.801045 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8d1a0536-ba4a-48ef-854f-d3bba7dafed3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:26.811143 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-07b28864-89a9-4ca4-ac5f-ba0ad01abfb8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1203 microversion: 2.1 time: 0.121849 May 10 14:09:26.821305 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 516/1058] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:26 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1203 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:26.953978 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8d1a0536-ba4a-48ef-854f-d3bba7dafed3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:26.961770 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8d1a0536-ba4a-48ef-854f-d3bba7dafed3 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1319 microversion: 2.1 time: 0.184395 May 10 14:09:26.962343 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 543/1059] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:26 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:27.827463 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bab4a1c9-69c2-482b-82c1-20aa3cefa7db tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:27.828031 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bab4a1c9-69c2-482b-82c1-20aa3cefa7db tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:27.834297 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bab4a1c9-69c2-482b-82c1-20aa3cefa7db tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:27.834746 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bab4a1c9-69c2-482b-82c1-20aa3cefa7db tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:27.835529 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bab4a1c9-69c2-482b-82c1-20aa3cefa7db tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:27.835970 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bab4a1c9-69c2-482b-82c1-20aa3cefa7db tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:27.982775 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7e0fcff0-e635-41f2-9af7-f7b67b10c2b9 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:27.983382 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7e0fcff0-e635-41f2-9af7-f7b67b10c2b9 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:27.992115 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7e0fcff0-e635-41f2-9af7-f7b67b10c2b9 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:27.992632 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7e0fcff0-e635-41f2-9af7-f7b67b10c2b9 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:27.993638 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7e0fcff0-e635-41f2-9af7-f7b67b10c2b9 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:27.994814 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7e0fcff0-e635-41f2-9af7-f7b67b10c2b9 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:28.043566 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bab4a1c9-69c2-482b-82c1-20aa3cefa7db tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:28.056797 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bab4a1c9-69c2-482b-82c1-20aa3cefa7db tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.232855 May 10 14:09:28.057995 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 517/1060] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:27 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:28.151398 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7e0fcff0-e635-41f2-9af7-f7b67b10c2b9 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:28.159580 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7e0fcff0-e635-41f2-9af7-f7b67b10c2b9 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1508 microversion: 2.1 time: 0.182517 May 10 14:09:28.160207 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 544/1061] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:27 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:28.178481 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2a1eefff-9eb3-40a4-ab8c-e8bf36718ae7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "807cf1bf-a2b0-43d7-866b-508eaebacf58", "device": "/dev/sdb"}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:28.180526 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2a1eefff-9eb3-40a4-ab8c-e8bf36718ae7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:28.186540 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2a1eefff-9eb3-40a4-ab8c-e8bf36718ae7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:28.186996 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2a1eefff-9eb3-40a4-ab8c-e8bf36718ae7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:28.187792 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2a1eefff-9eb3-40a4-ab8c-e8bf36718ae7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:28.188272 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2a1eefff-9eb3-40a4-ab8c-e8bf36718ae7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:28.277130 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-37ecaf7b-6df6-4639-9da3-752afec2b234 req-a281c7c2-3dbf-4cc4-be49-c79fe4415db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c8053d-f1c3-442e-9fbe-d47ecc4683a9", "tag": "ebadb043-e9de-4649-a139-09dacac9d1d9"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:28.293422 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-37ecaf7b-6df6-4639-9da3-752afec2b234 req-a281c7c2-3dbf-4cc4-be49-c79fe4415db0 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:28.293871 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-37ecaf7b-6df6-4639-9da3-752afec2b234 req-a281c7c2-3dbf-4cc4-be49-c79fe4415db0 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:28.307415 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-37ecaf7b-6df6-4639-9da3-752afec2b234 req-a281c7c2-3dbf-4cc4-be49-c79fe4415db0 service nova] Creating event network-changed:ebadb043-e9de-4649-a139-09dacac9d1d9 for instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 on hv-cinder-84067 May 10 14:09:28.314032 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-37ecaf7b-6df6-4639-9da3-752afec2b234 req-a281c7c2-3dbf-4cc4-be49-c79fe4415db0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041480 May 10 14:09:28.314959 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 545/1062] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:09:28.599586 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2a1eefff-9eb3-40a4-ab8c-e8bf36718ae7 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "POST /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427331 May 10 14:09:28.600391 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 518/1063] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 14:09:28 2022] POST /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:29.075272 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5b2788e1-620b-47a9-a296-809cdd86d42b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:29.075979 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5b2788e1-620b-47a9-a296-809cdd86d42b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:29.082527 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5b2788e1-620b-47a9-a296-809cdd86d42b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:29.082986 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5b2788e1-620b-47a9-a296-809cdd86d42b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:29.083769 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5b2788e1-620b-47a9-a296-809cdd86d42b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:29.084229 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5b2788e1-620b-47a9-a296-809cdd86d42b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:29.215992 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5b2788e1-620b-47a9-a296-809cdd86d42b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:29.223624 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5b2788e1-620b-47a9-a296-809cdd86d42b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.153175 May 10 14:09:29.224215 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 546/1064] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:29 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:30.240932 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-aaefad10-44fe-4506-ac66-b21ff52aec06 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:30.241639 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-aaefad10-44fe-4506-ac66-b21ff52aec06 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:30.247821 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-aaefad10-44fe-4506-ac66-b21ff52aec06 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:30.248308 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-aaefad10-44fe-4506-ac66-b21ff52aec06 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:30.249082 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-aaefad10-44fe-4506-ac66-b21ff52aec06 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:30.249522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-aaefad10-44fe-4506-ac66-b21ff52aec06 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:30.377073 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-aaefad10-44fe-4506-ac66-b21ff52aec06 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:30.384547 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-aaefad10-44fe-4506-ac66-b21ff52aec06 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.148112 May 10 14:09:30.384993 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 519/1065] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:30 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:31.402470 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ff9d7109-311c-487a-a607-c99e319d0407 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:31.403083 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ff9d7109-311c-487a-a607-c99e319d0407 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:31.409463 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ff9d7109-311c-487a-a607-c99e319d0407 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:31.409918 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ff9d7109-311c-487a-a607-c99e319d0407 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:31.410685 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ff9d7109-311c-487a-a607-c99e319d0407 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:31.411155 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ff9d7109-311c-487a-a607-c99e319d0407 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:31.540431 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ff9d7109-311c-487a-a607-c99e319d0407 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:31.549433 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ff9d7109-311c-487a-a607-c99e319d0407 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.151293 May 10 14:09:31.550011 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 547/1066] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:31 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:32.566803 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-371cb572-a5a9-4de1-9e92-92c13b0a9362 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:32.567343 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-371cb572-a5a9-4de1-9e92-92c13b0a9362 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:32.573635 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-371cb572-a5a9-4de1-9e92-92c13b0a9362 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:32.574082 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-371cb572-a5a9-4de1-9e92-92c13b0a9362 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:32.574849 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-371cb572-a5a9-4de1-9e92-92c13b0a9362 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:32.575284 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-371cb572-a5a9-4de1-9e92-92c13b0a9362 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:32.705889 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-371cb572-a5a9-4de1-9e92-92c13b0a9362 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:32.713107 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-371cb572-a5a9-4de1-9e92-92c13b0a9362 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.150309 May 10 14:09:32.713666 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 520/1067] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:32 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:33.729748 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f6ebc7de-bd68-4510-a2c5-629654498195 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:33.731021 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f6ebc7de-bd68-4510-a2c5-629654498195 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:33.737192 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f6ebc7de-bd68-4510-a2c5-629654498195 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:33.737641 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f6ebc7de-bd68-4510-a2c5-629654498195 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:33.738399 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f6ebc7de-bd68-4510-a2c5-629654498195 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:33.738829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f6ebc7de-bd68-4510-a2c5-629654498195 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:33.864640 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-f6ebc7de-bd68-4510-a2c5-629654498195 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:33.871899 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f6ebc7de-bd68-4510-a2c5-629654498195 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.145993 May 10 14:09:33.872493 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 548/1068] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:33 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:34.888532 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fc21943c-af84-4a59-b881-ef34c52454ea tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:34.889169 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fc21943c-af84-4a59-b881-ef34c52454ea tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:34.895854 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fc21943c-af84-4a59-b881-ef34c52454ea tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:34.896356 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fc21943c-af84-4a59-b881-ef34c52454ea tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:34.897139 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fc21943c-af84-4a59-b881-ef34c52454ea tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:34.897583 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fc21943c-af84-4a59-b881-ef34c52454ea tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:35.030072 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-fc21943c-af84-4a59-b881-ef34c52454ea tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:35.038959 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fc21943c-af84-4a59-b881-ef34c52454ea tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.154260 May 10 14:09:35.039533 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 521/1069] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:34 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:36.057454 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7da2eeff-49b3-425a-aef7-de847b1c270c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:36.058102 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7da2eeff-49b3-425a-aef7-de847b1c270c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:36.064962 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7da2eeff-49b3-425a-aef7-de847b1c270c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:36.065606 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7da2eeff-49b3-425a-aef7-de847b1c270c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:36.066506 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7da2eeff-49b3-425a-aef7-de847b1c270c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:36.067012 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7da2eeff-49b3-425a-aef7-de847b1c270c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:36.195098 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7da2eeff-49b3-425a-aef7-de847b1c270c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:36.202993 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7da2eeff-49b3-425a-aef7-de847b1c270c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.150169 May 10 14:09:36.203568 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 549/1070] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:36 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:37.219637 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-78412810-83ab-479d-9f83-dd3d55fca43b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:37.220339 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-78412810-83ab-479d-9f83-dd3d55fca43b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:37.226534 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-78412810-83ab-479d-9f83-dd3d55fca43b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:37.226978 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-78412810-83ab-479d-9f83-dd3d55fca43b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:37.227743 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-78412810-83ab-479d-9f83-dd3d55fca43b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:37.228245 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-78412810-83ab-479d-9f83-dd3d55fca43b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:37.357748 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-78412810-83ab-479d-9f83-dd3d55fca43b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:37.364955 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-78412810-83ab-479d-9f83-dd3d55fca43b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.149346 May 10 14:09:37.365518 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 522/1071] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:37 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:38.381854 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7558a888-f413-4794-988a-0aa920f2f8e2 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:38.382471 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7558a888-f413-4794-988a-0aa920f2f8e2 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:38.389386 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7558a888-f413-4794-988a-0aa920f2f8e2 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:38.389841 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7558a888-f413-4794-988a-0aa920f2f8e2 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:38.390904 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7558a888-f413-4794-988a-0aa920f2f8e2 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:38.391346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7558a888-f413-4794-988a-0aa920f2f8e2 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:38.519664 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7558a888-f413-4794-988a-0aa920f2f8e2 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:38.527505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7558a888-f413-4794-988a-0aa920f2f8e2 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.148970 May 10 14:09:38.528081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 550/1072] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:38 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:39.544074 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-095fabe5-be0a-413a-87e2-47f61ddae0ff tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:39.544651 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-095fabe5-be0a-413a-87e2-47f61ddae0ff tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:39.550944 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-095fabe5-be0a-413a-87e2-47f61ddae0ff tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:39.551394 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-095fabe5-be0a-413a-87e2-47f61ddae0ff tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:39.552181 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-095fabe5-be0a-413a-87e2-47f61ddae0ff tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:39.552625 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-095fabe5-be0a-413a-87e2-47f61ddae0ff tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:39.681878 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-095fabe5-be0a-413a-87e2-47f61ddae0ff tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:39.689312 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-095fabe5-be0a-413a-87e2-47f61ddae0ff tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.149706 May 10 14:09:39.689933 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 523/1073] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:39 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:40.706090 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-db37d9a5-2708-4424-8be8-fb7b409f8527 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:40.706731 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-db37d9a5-2708-4424-8be8-fb7b409f8527 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:40.712452 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-db37d9a5-2708-4424-8be8-fb7b409f8527 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:40.712904 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-db37d9a5-2708-4424-8be8-fb7b409f8527 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:40.713664 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-db37d9a5-2708-4424-8be8-fb7b409f8527 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:40.714098 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-db37d9a5-2708-4424-8be8-fb7b409f8527 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:40.851967 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-db37d9a5-2708-4424-8be8-fb7b409f8527 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:40.859184 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-db37d9a5-2708-4424-8be8-fb7b409f8527 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.157084 May 10 14:09:40.859734 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 551/1074] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:40 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:41.875740 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4a227bb4-cc61-41f2-babd-35ccded4cce4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:41.876418 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4a227bb4-cc61-41f2-babd-35ccded4cce4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:41.882650 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4a227bb4-cc61-41f2-babd-35ccded4cce4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:41.883095 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4a227bb4-cc61-41f2-babd-35ccded4cce4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:41.883850 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4a227bb4-cc61-41f2-babd-35ccded4cce4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:41.884313 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4a227bb4-cc61-41f2-babd-35ccded4cce4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:42.017016 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4a227bb4-cc61-41f2-babd-35ccded4cce4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:42.024511 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4a227bb4-cc61-41f2-babd-35ccded4cce4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.152966 May 10 14:09:42.025097 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 524/1075] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:41 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:42.999341 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-6f41ab21-329a-48d0-a374-087708c2a3d7 req-523be145-bb21-485d-ad00-2d2903e63a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69343f84-e94e-4334-b040-ab048b6795ac", "tag": "6daf67e0-ce03-4c62-acf8-42fa18634144"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:43.000222 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f281e07d-c53d-4ea0-a4c0-dfed904b35ac tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:43.004614 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f281e07d-c53d-4ea0-a4c0-dfed904b35ac tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:43.009242 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-6f41ab21-329a-48d0-a374-087708c2a3d7 req-523be145-bb21-485d-ad00-2d2903e63a1d service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:43.009983 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-6f41ab21-329a-48d0-a374-087708c2a3d7 req-523be145-bb21-485d-ad00-2d2903e63a1d service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:43.011280 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f281e07d-c53d-4ea0-a4c0-dfed904b35ac tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:43.011973 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f281e07d-c53d-4ea0-a4c0-dfed904b35ac tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:43.013297 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f281e07d-c53d-4ea0-a4c0-dfed904b35ac tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:43.013904 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-f281e07d-c53d-4ea0-a4c0-dfed904b35ac tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:43.023521 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-6f41ab21-329a-48d0-a374-087708c2a3d7 req-523be145-bb21-485d-ad00-2d2903e63a1d service nova] Creating event network-changed:6daf67e0-ce03-4c62-acf8-42fa18634144 for instance 69343f84-e94e-4334-b040-ab048b6795ac on hv-cinder-84067 May 10 14:09:43.029575 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-6f41ab21-329a-48d0-a374-087708c2a3d7 req-523be145-bb21-485d-ad00-2d2903e63a1d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033703 May 10 14:09:43.030558 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 525/1076] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:43.041592 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-a3bb0144-729b-4516-96f7-8a91172f70a7 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:43.041811 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-f281e07d-c53d-4ea0-a4c0-dfed904b35ac tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Going to try to terminate instance {{(pid=117154) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:09:43.042539 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-a3bb0144-729b-4516-96f7-8a91172f70a7 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:43.049519 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a3bb0144-729b-4516-96f7-8a91172f70a7 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:43.050202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a3bb0144-729b-4516-96f7-8a91172f70a7 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:43.051155 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a3bb0144-729b-4516-96f7-8a91172f70a7 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:43.051753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-a3bb0144-729b-4516-96f7-8a91172f70a7 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:43.124837 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f281e07d-c53d-4ea0-a4c0-dfed904b35ac tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "DELETE /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 204 len: 0 microversion: 2.1 time: 0.133705 May 10 14:09:43.125564 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 552/1077] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:09:42 2022] DELETE /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:09:43.134316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-9f7ffefd-190a-4775-a77a-528e52ac3e12 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:43.135032 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-9f7ffefd-190a-4775-a77a-528e52ac3e12 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:43.142129 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9f7ffefd-190a-4775-a77a-528e52ac3e12 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:43.142583 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9f7ffefd-190a-4775-a77a-528e52ac3e12 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:43.143423 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9f7ffefd-190a-4775-a77a-528e52ac3e12 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:43.143869 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-9f7ffefd-190a-4775-a77a-528e52ac3e12 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:43.192122 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-a3bb0144-729b-4516-96f7-8a91172f70a7 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:43.199753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-a3bb0144-729b-4516-96f7-8a91172f70a7 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.162337 May 10 14:09:43.209917 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 526/1078] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:43 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:43.275059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-9f7ffefd-190a-4775-a77a-528e52ac3e12 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:43.282650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-9f7ffefd-190a-4775-a77a-528e52ac3e12 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1576 microversion: 2.1 time: 0.152768 May 10 14:09:43.283248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 553/1079] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:43 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:43.966983 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-f5bf77dc-a3a3-46eb-993c-d60ce717f100 req-2737d0c8-db55-440d-8c51-c2b70edf11d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c8053d-f1c3-442e-9fbe-d47ecc4683a9", "name": "network-vif-plugged", "status": "completed", "tag": "ebadb043-e9de-4649-a139-09dacac9d1d9"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:43.975435 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-f5bf77dc-a3a3-46eb-993c-d60ce717f100 req-2737d0c8-db55-440d-8c51-c2b70edf11d3 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:43.975956 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-f5bf77dc-a3a3-46eb-993c-d60ce717f100 req-2737d0c8-db55-440d-8c51-c2b70edf11d3 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:43.987943 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-f5bf77dc-a3a3-46eb-993c-d60ce717f100 req-2737d0c8-db55-440d-8c51-c2b70edf11d3 service nova] Creating event network-vif-plugged:ebadb043-e9de-4649-a139-09dacac9d1d9 for instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 on hv-cinder-84067 May 10 14:09:43.992926 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-f5bf77dc-a3a3-46eb-993c-d60ce717f100 req-2737d0c8-db55-440d-8c51-c2b70edf11d3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030255 May 10 14:09:43.993702 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 527/1080] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:09:44.217543 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-94dec25c-d6eb-4528-b609-8dbd9fe88a30 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:44.218164 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-94dec25c-d6eb-4528-b609-8dbd9fe88a30 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:44.224561 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-94dec25c-d6eb-4528-b609-8dbd9fe88a30 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:44.225019 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-94dec25c-d6eb-4528-b609-8dbd9fe88a30 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:44.225804 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-94dec25c-d6eb-4528-b609-8dbd9fe88a30 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:44.226248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-94dec25c-d6eb-4528-b609-8dbd9fe88a30 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:44.355419 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4d0838f2-944d-48e0-a6bf-c59c566bdc01 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:44.356260 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4d0838f2-944d-48e0-a6bf-c59c566bdc01 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:44.358639 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-94dec25c-d6eb-4528-b609-8dbd9fe88a30 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:44.362312 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4d0838f2-944d-48e0-a6bf-c59c566bdc01 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:44.362862 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4d0838f2-944d-48e0-a6bf-c59c566bdc01 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:44.363834 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4d0838f2-944d-48e0-a6bf-c59c566bdc01 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:44.364295 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4d0838f2-944d-48e0-a6bf-c59c566bdc01 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:44.366040 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-94dec25c-d6eb-4528-b609-8dbd9fe88a30 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.152902 May 10 14:09:44.366656 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 554/1081] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:44 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:44.493696 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4d0838f2-944d-48e0-a6bf-c59c566bdc01 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:44.501287 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4d0838f2-944d-48e0-a6bf-c59c566bdc01 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1576 microversion: 2.1 time: 0.150514 May 10 14:09:44.501885 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 528/1082] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:44 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:45.382747 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-3971d4e0-0e38-4057-89be-f287e8eebaef tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:45.383354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-3971d4e0-0e38-4057-89be-f287e8eebaef tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:45.390155 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3971d4e0-0e38-4057-89be-f287e8eebaef tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:45.390852 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3971d4e0-0e38-4057-89be-f287e8eebaef tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:45.391615 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3971d4e0-0e38-4057-89be-f287e8eebaef tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:45.392047 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-3971d4e0-0e38-4057-89be-f287e8eebaef tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:45.517706 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-3971d4e0-0e38-4057-89be-f287e8eebaef tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:45.519198 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7b173891-9701-4520-8c0f-470ec52a7e96 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:45.519814 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7b173891-9701-4520-8c0f-470ec52a7e96 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:45.525059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-3971d4e0-0e38-4057-89be-f287e8eebaef tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.146142 May 10 14:09:45.525642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 555/1083] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:45 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:45.526110 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7b173891-9701-4520-8c0f-470ec52a7e96 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:45.526563 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7b173891-9701-4520-8c0f-470ec52a7e96 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:45.527344 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7b173891-9701-4520-8c0f-470ec52a7e96 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:45.527781 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7b173891-9701-4520-8c0f-470ec52a7e96 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:45.657094 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7b173891-9701-4520-8c0f-470ec52a7e96 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:45.664870 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7b173891-9701-4520-8c0f-470ec52a7e96 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1576 microversion: 2.1 time: 0.149771 May 10 14:09:45.665470 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 529/1084] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:45 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:46.541666 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-6eb9501c-86ce-4581-b6fa-cce5e6468dac tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:46.542287 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-6eb9501c-86ce-4581-b6fa-cce5e6468dac tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:46.549330 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6eb9501c-86ce-4581-b6fa-cce5e6468dac tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:46.549787 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6eb9501c-86ce-4581-b6fa-cce5e6468dac tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:46.550561 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6eb9501c-86ce-4581-b6fa-cce5e6468dac tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:46.551004 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-6eb9501c-86ce-4581-b6fa-cce5e6468dac tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:46.681748 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f8a6a9d3-be8a-435b-bae5-f51b8ed827f4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:46.682366 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f8a6a9d3-be8a-435b-bae5-f51b8ed827f4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:46.683801 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-6eb9501c-86ce-4581-b6fa-cce5e6468dac tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:46.688610 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f8a6a9d3-be8a-435b-bae5-f51b8ed827f4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:46.689284 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f8a6a9d3-be8a-435b-bae5-f51b8ed827f4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:46.690230 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f8a6a9d3-be8a-435b-bae5-f51b8ed827f4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:46.690851 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f8a6a9d3-be8a-435b-bae5-f51b8ed827f4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:46.691695 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-6eb9501c-86ce-4581-b6fa-cce5e6468dac tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1258 microversion: 2.1 time: 0.153710 May 10 14:09:46.692431 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 556/1085] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:46 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:46.852598 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f8a6a9d3-be8a-435b-bae5-f51b8ed827f4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:46.859864 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f8a6a9d3-be8a-435b-bae5-f51b8ed827f4 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1576 microversion: 2.1 time: 0.181961 May 10 14:09:46.860474 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 530/1086] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:46 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:47.543570 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-e3e43068-5891-4de0-aa11-c190b192010b req-1c6d81f4-8da7-47f3-b68a-730f3ebfa69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69343f84-e94e-4334-b040-ab048b6795ac", "name": "network-vif-deleted", "tag": "6daf67e0-ce03-4c62-acf8-42fa18634144"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:47.552432 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-e3e43068-5891-4de0-aa11-c190b192010b req-1c6d81f4-8da7-47f3-b68a-730f3ebfa69d service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.552879 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-e3e43068-5891-4de0-aa11-c190b192010b req-1c6d81f4-8da7-47f3-b68a-730f3ebfa69d service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.566436 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-e3e43068-5891-4de0-aa11-c190b192010b req-1c6d81f4-8da7-47f3-b68a-730f3ebfa69d service nova] Creating event network-vif-deleted:6daf67e0-ce03-4c62-acf8-42fa18634144 for instance 69343f84-e94e-4334-b040-ab048b6795ac on hv-cinder-84067 May 10 14:09:47.571309 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-e3e43068-5891-4de0-aa11-c190b192010b req-1c6d81f4-8da7-47f3-b68a-730f3ebfa69d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031431 May 10 14:09:47.571892 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 557/1087] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:47.708471 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7a6902cd-b432-48c5-af1b-8f8fec09572e tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:47.708998 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7a6902cd-b432-48c5-af1b-8f8fec09572e tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:47.715282 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7a6902cd-b432-48c5-af1b-8f8fec09572e tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.715729 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7a6902cd-b432-48c5-af1b-8f8fec09572e tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.717023 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7a6902cd-b432-48c5-af1b-8f8fec09572e tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.717456 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7a6902cd-b432-48c5-af1b-8f8fec09572e tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.877119 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-8dec6582-4952-4fa8-95c1-c643b3936350 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:47.878243 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-8dec6582-4952-4fa8-95c1-c643b3936350 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:47.885102 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8dec6582-4952-4fa8-95c1-c643b3936350 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.885756 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8dec6582-4952-4fa8-95c1-c643b3936350 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.886561 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8dec6582-4952-4fa8-95c1-c643b3936350 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.887002 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-8dec6582-4952-4fa8-95c1-c643b3936350 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.957026 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-8dec6582-4952-4fa8-95c1-c643b3936350 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:47.969730 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-8dec6582-4952-4fa8-95c1-c643b3936350 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 200 len: 1390 microversion: 2.1 time: 0.096782 May 10 14:09:47.970970 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 558/1088] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:47 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:48.149251 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7a6902cd-b432-48c5-af1b-8f8fec09572e tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:48.157080 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7a6902cd-b432-48c5-af1b-8f8fec09572e tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1442 microversion: 2.1 time: 0.452559 May 10 14:09:48.157649 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 531/1089] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:47 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1442 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:48.173367 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e4b2f900-ea1a-4c89-9a8b-577c57be6c58 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:48.173963 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e4b2f900-ea1a-4c89-9a8b-577c57be6c58 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:48.180011 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4b2f900-ea1a-4c89-9a8b-577c57be6c58 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:48.180495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4b2f900-ea1a-4c89-9a8b-577c57be6c58 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:48.181268 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4b2f900-ea1a-4c89-9a8b-577c57be6c58 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:48.181706 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e4b2f900-ea1a-4c89-9a8b-577c57be6c58 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:48.314165 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e4b2f900-ea1a-4c89-9a8b-577c57be6c58 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:48.322309 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e4b2f900-ea1a-4c89-9a8b-577c57be6c58 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1442 microversion: 2.1 time: 0.152842 May 10 14:09:48.323067 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 559/1090] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:48 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:48.922089 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-af78b974-a6d1-47b8-9669-cb060b76a299 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:48.922620 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-af78b974-a6d1-47b8-9669-cb060b76a299 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:48.928907 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-af78b974-a6d1-47b8-9669-cb060b76a299 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:48.929358 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-af78b974-a6d1-47b8-9669-cb060b76a299 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:48.930140 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-af78b974-a6d1-47b8-9669-cb060b76a299 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:48.930579 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-af78b974-a6d1-47b8-9669-cb060b76a299 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:48.987305 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-17538fbd-8234-4a95-9d6d-85bc1d5d8ffb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:48.987942 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-17538fbd-8234-4a95-9d6d-85bc1d5d8ffb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 69343f84-e94e-4334-b040-ab048b6795ac] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:48.994751 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-17538fbd-8234-4a95-9d6d-85bc1d5d8ffb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:48.995202 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-17538fbd-8234-4a95-9d6d-85bc1d5d8ffb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:48.996034 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-17538fbd-8234-4a95-9d6d-85bc1d5d8ffb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:48.996516 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-17538fbd-8234-4a95-9d6d-85bc1d5d8ffb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:49.011215 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-17538fbd-8234-4a95-9d6d-85bc1d5d8ffb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] HTTP exception thrown: Instance 69343f84-e94e-4334-b040-ab048b6795ac could not be found. May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-17538fbd-8234-4a95-9d6d-85bc1d5d8ffb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Request method failure captured: May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac HTTP/1.1 May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABienA71HtoIk-GqBMgFliyJhCDwZfIHlboG5nza-Cssw4HihcBMb0ADd-LikkHL831Qlg0OEwRJ-BXtS4KlrS_jM36DS-HVOT404UCXRk99pFgoA8ewTtmBYCLxEro9-qCFBPrgWBvARKkCB3Uf-xf7cE9Dx4pynfGe43xPMGSOfiWWpU May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 104740054c3a47ca8cc3cb262d975fd5 May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-TestVolumeBootPattern-253187725 May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:09:49.012974 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:09:49.014999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:09:49.014999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-TestVolumeBootPattern-253187725 May 10 14:09:49.014999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 104740054c3a47ca8cc3cb262d975fd5 May 10 14:09:49.014999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-TestVolumeBootPattern-253187725 May 10 14:09:49.014999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-TestVolumeBootPattern-253187725-project May 10 14:09:49.014999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:09:49.014999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:09:49.014999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 9d87a4de3fbf4cbb9e21523634007629 May 10 14:09:49.014999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-TestVolumeBootPattern-253187725-project May 10 14:09:49.014999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:09:49.014999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 69343f84-e94e-4334-b040-ab048b6795ac could not be found. May 10 14:09:49.014999 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '69343f84-e94e-4334-b040-ab048b6795ac'} May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69343f84-e94e-4334-b040-ab048b6795ac could not be found. May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:49.016106 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69343f84-e94e-4334-b040-ab048b6795ac could not be found. May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69343f84-e94e-4334-b040-ab048b6795ac could not be found. May 10 14:09:49.019435 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:49.022079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-17538fbd-8234-4a95-9d6d-85bc1d5d8ffb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Returning 404 to user: Instance 69343f84-e94e-4334-b040-ab048b6795ac could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:49.022079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-17538fbd-8234-4a95-9d6d-85bc1d5d8ffb tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac" status: 404 len: 111 microversion: 2.1 time: 0.031837 May 10 14:09:49.022079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 560/1091] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:48 2022] GET /compute/v2.1/servers/69343f84-e94e-4334-b040-ab048b6795ac => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:09:49.179634 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-af78b974-a6d1-47b8-9669-cb060b76a299 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lazy-loading 'services' on Instance uuid 04ea8970-dc8e-45b8-8cf4-2e986ccd8564 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:09:49.251408 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-af78b974-a6d1-47b8-9669-cb060b76a299 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "DELETE /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564/os-volume_attachments/807cf1bf-a2b0-43d7-866b-508eaebacf58" status: 202 len: 0 microversion: 2.1 time: 0.333163 May 10 14:09:49.251997 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 532/1092] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 14:09:48 2022] DELETE /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564/os-volume_attachments/807cf1bf-a2b0-43d7-866b-508eaebacf58 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:09:50.348090 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-f8967c63-2049-4f75-8ffa-4092cef86b86 req-3bd9e859-fbc5-4ec7-8a46-4feec6f01fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c8053d-f1c3-442e-9fbe-d47ecc4683a9", "tag": "ebadb043-e9de-4649-a139-09dacac9d1d9"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:50.356409 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-f8967c63-2049-4f75-8ffa-4092cef86b86 req-3bd9e859-fbc5-4ec7-8a46-4feec6f01fc4 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:50.357400 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-f8967c63-2049-4f75-8ffa-4092cef86b86 req-3bd9e859-fbc5-4ec7-8a46-4feec6f01fc4 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:50.372302 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-f8967c63-2049-4f75-8ffa-4092cef86b86 req-3bd9e859-fbc5-4ec7-8a46-4feec6f01fc4 service nova] Creating event network-changed:ebadb043-e9de-4649-a139-09dacac9d1d9 for instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 on hv-cinder-84067 May 10 14:09:50.377563 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4b107c11-2570-4798-af0c-efe9ef9a05e0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:50.378102 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-f8967c63-2049-4f75-8ffa-4092cef86b86 req-3bd9e859-fbc5-4ec7-8a46-4feec6f01fc4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033531 May 10 14:09:50.378691 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4b107c11-2570-4798-af0c-efe9ef9a05e0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:50.383052 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 561/1093] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:50.385200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4b107c11-2570-4798-af0c-efe9ef9a05e0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:50.385741 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4b107c11-2570-4798-af0c-efe9ef9a05e0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:50.386530 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4b107c11-2570-4798-af0c-efe9ef9a05e0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:50.386986 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4b107c11-2570-4798-af0c-efe9ef9a05e0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:50.411629 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4b107c11-2570-4798-af0c-efe9ef9a05e0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Going to try to terminate instance {{(pid=117153) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:09:50.507961 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4b107c11-2570-4798-af0c-efe9ef9a05e0 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "DELETE /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 204 len: 0 microversion: 2.1 time: 0.134955 May 10 14:09:50.509028 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 533/1094] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:09:50 2022] DELETE /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 14:09:50.518634 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-89e1e351-13b8-4161-8fe1-b89adeccca03 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:50.519595 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-89e1e351-13b8-4161-8fe1-b89adeccca03 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:50.525713 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89e1e351-13b8-4161-8fe1-b89adeccca03 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:50.526160 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89e1e351-13b8-4161-8fe1-b89adeccca03 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:50.527134 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89e1e351-13b8-4161-8fe1-b89adeccca03 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:50.527650 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-89e1e351-13b8-4161-8fe1-b89adeccca03 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:50.686717 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-89e1e351-13b8-4161-8fe1-b89adeccca03 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:50.694675 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-89e1e351-13b8-4161-8fe1-b89adeccca03 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1514 microversion: 2.1 time: 0.180782 May 10 14:09:50.695294 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 562/1095] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:50 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:51.713118 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f9a858be-9b39-4781-93be-0af5cfc12099 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:51.713817 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f9a858be-9b39-4781-93be-0af5cfc12099 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:51.720748 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9a858be-9b39-4781-93be-0af5cfc12099 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:51.721200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9a858be-9b39-4781-93be-0af5cfc12099 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:51.721971 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9a858be-9b39-4781-93be-0af5cfc12099 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:51.722406 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f9a858be-9b39-4781-93be-0af5cfc12099 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:51.848842 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-f9a858be-9b39-4781-93be-0af5cfc12099 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:51.856195 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f9a858be-9b39-4781-93be-0af5cfc12099 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1514 microversion: 2.1 time: 0.147350 May 10 14:09:51.856883 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 534/1096] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:51 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:52.165129 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5e54367b-6a32-4afc-af54-2a229034ee30 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:52.165704 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5e54367b-6a32-4afc-af54-2a229034ee30 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:52.172774 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5e54367b-6a32-4afc-af54-2a229034ee30 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:52.173223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5e54367b-6a32-4afc-af54-2a229034ee30 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:52.174003 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5e54367b-6a32-4afc-af54-2a229034ee30 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:52.174443 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5e54367b-6a32-4afc-af54-2a229034ee30 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:52.199622 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5e54367b-6a32-4afc-af54-2a229034ee30 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Going to try to terminate instance {{(pid=117154) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:09:52.288536 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5e54367b-6a32-4afc-af54-2a229034ee30 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "DELETE /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 204 len: 0 microversion: 2.1 time: 0.127055 May 10 14:09:52.289125 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 563/1097] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:09:52 2022] DELETE /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:09:52.297869 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-fd70b15d-a46a-46e1-90ad-d71c1121cd4f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:52.298567 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-fd70b15d-a46a-46e1-90ad-d71c1121cd4f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:52.304653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fd70b15d-a46a-46e1-90ad-d71c1121cd4f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:52.305184 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fd70b15d-a46a-46e1-90ad-d71c1121cd4f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:52.306147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fd70b15d-a46a-46e1-90ad-d71c1121cd4f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:52.306588 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-fd70b15d-a46a-46e1-90ad-d71c1121cd4f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:52.399701 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-53219f70-dbce-4586-b724-911cfbe78d3d req-2ab23c76-94a2-4e83-bb32-0165f05a55ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821e2fc1-0f9b-40f0-a08e-cb87df184140", "tag": "1b71aba5-cc9f-45c9-8184-f38605a005e7"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:52.408305 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-53219f70-dbce-4586-b724-911cfbe78d3d req-2ab23c76-94a2-4e83-bb32-0165f05a55ce service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:52.408783 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-53219f70-dbce-4586-b724-911cfbe78d3d req-2ab23c76-94a2-4e83-bb32-0165f05a55ce service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:52.421966 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-53219f70-dbce-4586-b724-911cfbe78d3d req-2ab23c76-94a2-4e83-bb32-0165f05a55ce service nova] Creating event network-changed:1b71aba5-cc9f-45c9-8184-f38605a005e7 for instance 821e2fc1-0f9b-40f0-a08e-cb87df184140 on hv-cinder-84067 May 10 14:09:52.427238 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-53219f70-dbce-4586-b724-911cfbe78d3d req-2ab23c76-94a2-4e83-bb32-0165f05a55ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031556 May 10 14:09:52.427987 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 564/1098] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:09:52.447003 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-fd70b15d-a46a-46e1-90ad-d71c1121cd4f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:52.454255 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-fd70b15d-a46a-46e1-90ad-d71c1121cd4f tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1575 microversion: 2.1 time: 0.160945 May 10 14:09:52.454829 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 535/1099] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:52 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:52.873678 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-d8c79b8d-eb63-48af-b0c3-1fb760bfd588 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:52.874385 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-d8c79b8d-eb63-48af-b0c3-1fb760bfd588 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:52.880536 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d8c79b8d-eb63-48af-b0c3-1fb760bfd588 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:52.880983 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d8c79b8d-eb63-48af-b0c3-1fb760bfd588 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:52.881745 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d8c79b8d-eb63-48af-b0c3-1fb760bfd588 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:52.882180 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-d8c79b8d-eb63-48af-b0c3-1fb760bfd588 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:53.019022 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-d8c79b8d-eb63-48af-b0c3-1fb760bfd588 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:53.026510 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-d8c79b8d-eb63-48af-b0c3-1fb760bfd588 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1514 microversion: 2.1 time: 0.157036 May 10 14:09:53.027086 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 565/1100] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:52 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:53.471416 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9275301a-451e-4e96-9e3a-9d0363940ac8 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:53.472022 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9275301a-451e-4e96-9e3a-9d0363940ac8 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:53.478349 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9275301a-451e-4e96-9e3a-9d0363940ac8 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:53.478793 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9275301a-451e-4e96-9e3a-9d0363940ac8 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:53.479556 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9275301a-451e-4e96-9e3a-9d0363940ac8 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:53.479990 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9275301a-451e-4e96-9e3a-9d0363940ac8 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:53.605190 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-9275301a-451e-4e96-9e3a-9d0363940ac8 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:53.613080 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9275301a-451e-4e96-9e3a-9d0363940ac8 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1575 microversion: 2.1 time: 0.145576 May 10 14:09:53.613652 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 536/1101] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:53 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:54.044973 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-1fce2a47-36bd-4d9a-86a1-41dce6b2ba40 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:54.045774 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-1fce2a47-36bd-4d9a-86a1-41dce6b2ba40 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:54.052409 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1fce2a47-36bd-4d9a-86a1-41dce6b2ba40 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:54.052863 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1fce2a47-36bd-4d9a-86a1-41dce6b2ba40 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:54.053865 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1fce2a47-36bd-4d9a-86a1-41dce6b2ba40 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:54.054147 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-1fce2a47-36bd-4d9a-86a1-41dce6b2ba40 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:54.233782 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-1fce2a47-36bd-4d9a-86a1-41dce6b2ba40 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:54.241116 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-1fce2a47-36bd-4d9a-86a1-41dce6b2ba40 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1514 microversion: 2.1 time: 0.201085 May 10 14:09:54.241683 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 566/1102] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:54 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:54.632078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1fb2efe7-f1f2-4c66-980f-798f8ba40cda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:54.633436 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1fb2efe7-f1f2-4c66-980f-798f8ba40cda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:54.642316 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-cc049763-1f45-4732-b39b-239ff235c857 req-0393eab1-7827-42b1-8b13-01d150eb09de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ea8970-dc8e-45b8-8cf4-2e986ccd8564", "name": "network-vif-deleted", "tag": "235f625c-dada-4f4d-9a4c-affc95ada567"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:54.656551 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1fb2efe7-f1f2-4c66-980f-798f8ba40cda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:54.657014 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1fb2efe7-f1f2-4c66-980f-798f8ba40cda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:54.657816 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1fb2efe7-f1f2-4c66-980f-798f8ba40cda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:54.658260 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1fb2efe7-f1f2-4c66-980f-798f8ba40cda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:54.665346 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-cc049763-1f45-4732-b39b-239ff235c857 req-0393eab1-7827-42b1-8b13-01d150eb09de service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:54.665719 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-cc049763-1f45-4732-b39b-239ff235c857 req-0393eab1-7827-42b1-8b13-01d150eb09de service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:54.690805 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-cc049763-1f45-4732-b39b-239ff235c857 req-0393eab1-7827-42b1-8b13-01d150eb09de service nova] Creating event network-vif-deleted:235f625c-dada-4f4d-9a4c-affc95ada567 for instance 04ea8970-dc8e-45b8-8cf4-2e986ccd8564 on hv-cinder-84067 May 10 14:09:54.701721 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-cc049763-1f45-4732-b39b-239ff235c857 req-0393eab1-7827-42b1-8b13-01d150eb09de service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064591 May 10 14:09:54.702333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 567/1103] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:09:54.757897 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1fb2efe7-f1f2-4c66-980f-798f8ba40cda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d87a4de3fbf4cbb9e21523634007629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104740054c3a47ca8cc3cb262d975fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:54.759625 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-068adb36-0425-41fe-a871-b706436903f6 req-9ab77bb7-6bc9-4b17-934e-78633c26a6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821e2fc1-0f9b-40f0-a08e-cb87df184140", "name": "network-vif-deleted", "tag": "1b71aba5-cc9f-45c9-8184-f38605a005e7"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:54.768768 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1fb2efe7-f1f2-4c66-980f-798f8ba40cda tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 200 len: 1508 microversion: 2.1 time: 0.140580 May 10 14:09:54.769395 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 537/1104] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:54 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 1508 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:54.771951 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-068adb36-0425-41fe-a871-b706436903f6 req-9ab77bb7-6bc9-4b17-934e-78633c26a6e2 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:54.772434 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-068adb36-0425-41fe-a871-b706436903f6 req-9ab77bb7-6bc9-4b17-934e-78633c26a6e2 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:54.783829 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-068adb36-0425-41fe-a871-b706436903f6 req-9ab77bb7-6bc9-4b17-934e-78633c26a6e2 service nova] Creating event network-vif-deleted:1b71aba5-cc9f-45c9-8184-f38605a005e7 for instance 821e2fc1-0f9b-40f0-a08e-cb87df184140 on hv-cinder-84067 May 10 14:09:54.789500 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-068adb36-0425-41fe-a871-b706436903f6 req-9ab77bb7-6bc9-4b17-934e-78633c26a6e2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033979 May 10 14:09:54.790115 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 568/1105] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:09:55.258783 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-431eba1a-d0c4-4445-b83e-68cb00747713 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:55.259396 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-431eba1a-d0c4-4445-b83e-68cb00747713 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:55.266202 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-431eba1a-d0c4-4445-b83e-68cb00747713 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:55.266593 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-431eba1a-d0c4-4445-b83e-68cb00747713 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:55.267411 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-431eba1a-d0c4-4445-b83e-68cb00747713 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:55.267856 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-431eba1a-d0c4-4445-b83e-68cb00747713 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:55.299718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-431eba1a-d0c4-4445-b83e-68cb00747713 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:55.300191 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-431eba1a-d0c4-4445-b83e-68cb00747713 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:55.300653 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-431eba1a-d0c4-4445-b83e-68cb00747713 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lazy-loading 'fault' on Instance uuid 04ea8970-dc8e-45b8-8cf4-2e986ccd8564 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:09:55.342030 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-431eba1a-d0c4-4445-b83e-68cb00747713 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2afab5deb8c34f058c659a22a3402c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:55.348672 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-431eba1a-d0c4-4445-b83e-68cb00747713 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 200 len: 1309 microversion: 2.1 time: 0.093736 May 10 14:09:55.349236 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 538/1106] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:55 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:55.790866 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-234f34bb-7441-4344-ac57-b84b3b8dc166 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:55.791490 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-234f34bb-7441-4344-ac57-b84b3b8dc166 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 821e2fc1-0f9b-40f0-a08e-cb87df184140] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:55.798572 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-234f34bb-7441-4344-ac57-b84b3b8dc166 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:55.799027 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-234f34bb-7441-4344-ac57-b84b3b8dc166 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:55.799810 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-234f34bb-7441-4344-ac57-b84b3b8dc166 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:55.800287 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-234f34bb-7441-4344-ac57-b84b3b8dc166 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:55.814951 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-234f34bb-7441-4344-ac57-b84b3b8dc166 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] HTTP exception thrown: Instance 821e2fc1-0f9b-40f0-a08e-cb87df184140 could not be found. May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-234f34bb-7441-4344-ac57-b84b3b8dc166 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Request method failure captured: May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 HTTP/1.1 May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABienA71HtoIk-GqBMgFliyJhCDwZfIHlboG5nza-Cssw4HihcBMb0ADd-LikkHL831Qlg0OEwRJ-BXtS4KlrS_jM36DS-HVOT404UCXRk99pFgoA8ewTtmBYCLxEro9-qCFBPrgWBvARKkCB3Uf-xf7cE9Dx4pynfGe43xPMGSOfiWWpU May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 104740054c3a47ca8cc3cb262d975fd5 May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-TestVolumeBootPattern-253187725 May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:09:55.820881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:09:55.822505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:09:55.822505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-TestVolumeBootPattern-253187725 May 10 14:09:55.822505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 104740054c3a47ca8cc3cb262d975fd5 May 10 14:09:55.822505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-TestVolumeBootPattern-253187725 May 10 14:09:55.822505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-TestVolumeBootPattern-253187725-project May 10 14:09:55.822505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:09:55.822505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:09:55.822505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 9d87a4de3fbf4cbb9e21523634007629 May 10 14:09:55.822505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-TestVolumeBootPattern-253187725-project May 10 14:09:55.822505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:09:55.822505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 821e2fc1-0f9b-40f0-a08e-cb87df184140 could not be found. May 10 14:09:55.822505 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '821e2fc1-0f9b-40f0-a08e-cb87df184140'} May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821e2fc1-0f9b-40f0-a08e-cb87df184140 could not be found. May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:55.823361 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821e2fc1-0f9b-40f0-a08e-cb87df184140 could not be found. May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821e2fc1-0f9b-40f0-a08e-cb87df184140 could not be found. May 10 14:09:55.824651 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:55.825822 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-234f34bb-7441-4344-ac57-b84b3b8dc166 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Returning 404 to user: Instance 821e2fc1-0f9b-40f0-a08e-cb87df184140 could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:55.825822 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-234f34bb-7441-4344-ac57-b84b3b8dc166 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140" status: 404 len: 111 microversion: 2.1 time: 0.040532 May 10 14:09:55.825822 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 569/1107] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:55 2022] GET /compute/v2.1/servers/821e2fc1-0f9b-40f0-a08e-cb87df184140 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:09:56.272501 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9ad08061-15d6-4aae-adfc-3fa675e0ed55 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:56.273004 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-9ad08061-15d6-4aae-adfc-3fa675e0ed55 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:56.279798 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9ad08061-15d6-4aae-adfc-3fa675e0ed55 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:56.280273 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9ad08061-15d6-4aae-adfc-3fa675e0ed55 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:56.281051 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9ad08061-15d6-4aae-adfc-3fa675e0ed55 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:56.281501 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-9ad08061-15d6-4aae-adfc-3fa675e0ed55 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:56.295569 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-9ad08061-15d6-4aae-adfc-3fa675e0ed55 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] HTTP exception thrown: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9ad08061-15d6-4aae-adfc-3fa675e0ed55 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Request method failure captured: May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: DELETE /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b HTTP/1.1 May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABienA71HtoIk-GqBMgFliyJhCDwZfIHlboG5nza-Cssw4HihcBMb0ADd-LikkHL831Qlg0OEwRJ-BXtS4KlrS_jM36DS-HVOT404UCXRk99pFgoA8ewTtmBYCLxEro9-qCFBPrgWBvARKkCB3Uf-xf7cE9Dx4pynfGe43xPMGSOfiWWpU May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 104740054c3a47ca8cc3cb262d975fd5 May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-TestVolumeBootPattern-253187725 May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:09:56.297279 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:09:56.298879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:09:56.298879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-TestVolumeBootPattern-253187725 May 10 14:09:56.298879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 104740054c3a47ca8cc3cb262d975fd5 May 10 14:09:56.298879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-TestVolumeBootPattern-253187725 May 10 14:09:56.298879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-TestVolumeBootPattern-253187725-project May 10 14:09:56.298879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:09:56.298879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:09:56.298879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 9d87a4de3fbf4cbb9e21523634007629 May 10 14:09:56.298879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-TestVolumeBootPattern-253187725-project May 10 14:09:56.298879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:09:56.298879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:09:56.298879 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '2288a3f8-70db-4951-acaf-f839a42ed73b'} May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:56.299769 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:09:56.301078 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:56.302354 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-9ad08061-15d6-4aae-adfc-3fa675e0ed55 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Returning 404 to user: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:56.302354 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-9ad08061-15d6-4aae-adfc-3fa675e0ed55 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 404 len: 111 microversion: 2.1 time: 0.030072 May 10 14:09:56.302354 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 539/1108] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:09:56 2022] DELETE /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:09:56.307113 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-073a4be1-3c42-499d-8701-1788b03dd601 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:56.307732 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-073a4be1-3c42-499d-8701-1788b03dd601 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] [instance: 2288a3f8-70db-4951-acaf-f839a42ed73b] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:56.313605 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-073a4be1-3c42-499d-8701-1788b03dd601 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:56.314057 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-073a4be1-3c42-499d-8701-1788b03dd601 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:56.314828 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-073a4be1-3c42-499d-8701-1788b03dd601 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:56.315273 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-073a4be1-3c42-499d-8701-1788b03dd601 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:56.328973 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.wsgi [None req-073a4be1-3c42-499d-8701-1788b03dd601 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] HTTP exception thrown: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-073a4be1-3c42-499d-8701-1788b03dd601 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Request method failure captured: May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: request: GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b HTTP/1.1 May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept: application/json May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Accept-Encoding: identity May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Connection: close May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Length: 0 May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Content-Type: application/json May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Host: 10.222.0.49 May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Openstack-System-Scope: None May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: User-Agent: python-urllib3/1.26.9 May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Auth-Token: gAAAAABienA71HtoIk-GqBMgFliyJhCDwZfIHlboG5nza-Cssw4HihcBMb0ADd-LikkHL831Qlg0OEwRJ-BXtS4KlrS_jM36DS-HVOT404UCXRk99pFgoA8ewTtmBYCLxEro9-qCFBPrgWBvARKkCB3Uf-xf7cE9Dx4pynfGe43xPMGSOfiWWpU May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Id: None May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Domain-Name: None May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Identity-Status: Confirmed May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Is-Admin-Project: True May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Id: default May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Domain-Name: Default May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Id: 104740054c3a47ca8cc3cb262d975fd5 May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Project-Name: tempest-TestVolumeBootPattern-253187725 May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Role: reader,member May 10 14:09:56.330478 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Roles: reader,member May 10 14:09:56.332059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/104740054c3a47ca8cc3cb262d975fd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:09:56.332059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant: tempest-TestVolumeBootPattern-253187725 May 10 14:09:56.332059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Id: 104740054c3a47ca8cc3cb262d975fd5 May 10 14:09:56.332059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-Tenant-Name: tempest-TestVolumeBootPattern-253187725 May 10 14:09:56.332059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User: tempest-TestVolumeBootPattern-253187725-project May 10 14:09:56.332059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Id: default May 10 14:09:56.332059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Domain-Name: Default May 10 14:09:56.332059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Id: 9d87a4de3fbf4cbb9e21523634007629 May 10 14:09:56.332059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: X-User-Name: tempest-TestVolumeBootPattern-253187725-project May 10 14:09:56.332059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: method: > May 10 14:09:56.332059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: exception: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:09:56.332059 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: action_args: {'id': '2288a3f8-70db-4951-acaf-f839a42ed73b'} May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:56.332989 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. May 10 14:09:56.334531 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR nova.api.openstack.wsgi May 10 14:09:56.335862 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-073a4be1-3c42-499d-8701-1788b03dd601 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Returning 404 to user: Instance 2288a3f8-70db-4951-acaf-f839a42ed73b could not be found. {{(pid=117154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:56.335862 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-073a4be1-3c42-499d-8701-1788b03dd601 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b" status: 404 len: 111 microversion: 2.1 time: 0.028538 May 10 14:09:56.335862 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 570/1109] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:56 2022] GET /compute/v2.1/servers/2288a3f8-70db-4951-acaf-f839a42ed73b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:09:56.366207 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8d58eadb-a488-449a-ae69-ed87da07e362 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:56.367318 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-8d58eadb-a488-449a-ae69-ed87da07e362 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] [instance: 04ea8970-dc8e-45b8-8cf4-2e986ccd8564] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:56.373706 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8d58eadb-a488-449a-ae69-ed87da07e362 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:56.374171 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8d58eadb-a488-449a-ae69-ed87da07e362 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:56.374950 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8d58eadb-a488-449a-ae69-ed87da07e362 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:56.375380 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-8d58eadb-a488-449a-ae69-ed87da07e362 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:56.389727 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-8d58eadb-a488-449a-ae69-ed87da07e362 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] HTTP exception thrown: Instance 04ea8970-dc8e-45b8-8cf4-2e986ccd8564 could not be found. May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8d58eadb-a488-449a-ae69-ed87da07e362 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Request method failure captured: May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 HTTP/1.1 May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABienGtIOq-wUYz9ohuVjIerh32jr3rmwniMQwvd04mPpvk5MC9g0jgcC1clcGfyiuURpUXmwJ5c3DQidl58G96wLoA8W1XZap4XZYWofBpk6p2d2NUAqJ93T2C8i96tXj3LYOsLRplmHeTs7V9kHd6-Ju3WNifZTRb42uk1awDuINwW9I May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: a2a2e2e6222f48ebae4e9f9d7e9e8a4d May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1742444496 May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:09:56.391507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:09:56.392952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2a2e2e6222f48ebae4e9f9d7e9e8a4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2a2e2e6222f48ebae4e9f9d7e9e8a4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2a2e2e6222f48ebae4e9f9d7e9e8a4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2a2e2e6222f48ebae4e9f9d7e9e8a4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:09:56.392952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-VolumesSnapshotTestJSON-1742444496 May 10 14:09:56.392952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: a2a2e2e6222f48ebae4e9f9d7e9e8a4d May 10 14:09:56.392952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1742444496 May 10 14:09:56.392952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-VolumesSnapshotTestJSON-1742444496-project May 10 14:09:56.392952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:09:56.392952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:09:56.392952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: 2afab5deb8c34f058c659a22a3402c59 May 10 14:09:56.392952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-VolumesSnapshotTestJSON-1742444496-project May 10 14:09:56.392952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:09:56.392952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 04ea8970-dc8e-45b8-8cf4-2e986ccd8564 could not be found. May 10 14:09:56.392952 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '04ea8970-dc8e-45b8-8cf4-2e986ccd8564'} May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ea8970-dc8e-45b8-8cf4-2e986ccd8564 could not be found. May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:56.393734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ea8970-dc8e-45b8-8cf4-2e986ccd8564 could not be found. May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ea8970-dc8e-45b8-8cf4-2e986ccd8564 could not be found. May 10 14:09:56.395084 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:09:56.396250 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-8d58eadb-a488-449a-ae69-ed87da07e362 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] Returning 404 to user: Instance 04ea8970-dc8e-45b8-8cf4-2e986ccd8564 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:56.396250 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-8d58eadb-a488-449a-ae69-ed87da07e362 tempest-VolumesSnapshotTestJSON-1742444496 tempest-VolumesSnapshotTestJSON-1742444496-project] 10.222.0.49 "GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564" status: 404 len: 111 microversion: 2.1 time: 0.031113 May 10 14:09:56.396250 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 540/1110] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:09:56 2022] GET /compute/v2.1/servers/04ea8970-dc8e-45b8-8cf4-2e986ccd8564 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:09:57.633614 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-15e069ab-4134-4ee1-ad5f-3bb39e29d597 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] Calling method '.version_select at 0x7f5f80286670>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:57.655223 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-15e069ab-4134-4ee1-ad5f-3bb39e29d597 tempest-TestVolumeBootPattern-253187725 tempest-TestVolumeBootPattern-253187725-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-379745293" status: 202 len: 0 microversion: 2.1 time: 0.025582 May 10 14:09:57.655822 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 571/1111] 10.222.0.49 () {58 vars in 1259 bytes} [Tue May 10 14:09:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-379745293 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:09:58.893588 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:09:58.894121 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Tue May 10 14:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:11:46.796760 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:11:46.797447 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Tue May 10 14:11:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:11:47.353955 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c8d0425e-9577-43be-b01e-95ec83a52e68] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 14:11:47.357931 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-3168c88c-f74e-4fc1-9bc4-d1ea64f23057 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:47.358458 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-3168c88c-f74e-4fc1-9bc4-d1ea64f23057 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:47.365622 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3168c88c-f74e-4fc1-9bc4-d1ea64f23057 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:47.366069 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3168c88c-f74e-4fc1-9bc4-d1ea64f23057 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:47.366834 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3168c88c-f74e-4fc1-9bc4-d1ea64f23057 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:47.367269 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-3168c88c-f74e-4fc1-9bc4-d1ea64f23057 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:47.389718 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.objects.instance [None req-3168c88c-f74e-4fc1-9bc4-d1ea64f23057 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lazy-loading 'flavor' on Instance uuid 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 {{(pid=117153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:11:47.457991 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-3168c88c-f74e-4fc1-9bc4-d1ea64f23057 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "POST /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9/action" status: 202 len: 0 microversion: 2.1 time: 0.105685 May 10 14:11:47.458571 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 541/1112] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:11:47 2022] POST /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:11:47.465657 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27d9f8ec-de83-4c1d-b952-d59bd3d31c79] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 14:11:47.469326 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a686931a-524e-42f8-b8ab-78b90f2f8bf6 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:47.469936 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a686931a-524e-42f8-b8ab-78b90f2f8bf6 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:47.477124 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a686931a-524e-42f8-b8ab-78b90f2f8bf6 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:47.477582 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a686931a-524e-42f8-b8ab-78b90f2f8bf6 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:47.478351 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a686931a-524e-42f8-b8ab-78b90f2f8bf6 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:47.478784 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a686931a-524e-42f8-b8ab-78b90f2f8bf6 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:47.609203 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a686931a-524e-42f8-b8ab-78b90f2f8bf6 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:47.617352 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a686931a-524e-42f8-b8ab-78b90f2f8bf6 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.154500 May 10 14:11:47.617924 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 572/1113] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:11:47 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:48.635920 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c375af79-151f-46b8-af31-b5170cd74ec8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:48.636641 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c375af79-151f-46b8-af31-b5170cd74ec8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:48.644510 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c375af79-151f-46b8-af31-b5170cd74ec8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:48.645459 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c375af79-151f-46b8-af31-b5170cd74ec8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:48.646226 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c375af79-151f-46b8-af31-b5170cd74ec8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:48.646667 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c375af79-151f-46b8-af31-b5170cd74ec8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:48.651979 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO oslo.messaging._drivers.impl_rabbit [-] [c8d0425e-9577-43be-b01e-95ec83a52e68] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 48106. May 10 14:11:48.882460 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c375af79-151f-46b8-af31-b5170cd74ec8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:48.889716 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c375af79-151f-46b8-af31-b5170cd74ec8 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.258782 May 10 14:11:48.890221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 542/1114] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:11:48 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:49.907598 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7aee30af-6c55-4d6b-8d77-ac0032b92fab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:49.908262 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7aee30af-6c55-4d6b-8d77-ac0032b92fab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:49.916150 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7aee30af-6c55-4d6b-8d77-ac0032b92fab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:49.916707 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7aee30af-6c55-4d6b-8d77-ac0032b92fab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:49.917485 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7aee30af-6c55-4d6b-8d77-ac0032b92fab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:49.917927 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7aee30af-6c55-4d6b-8d77-ac0032b92fab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:49.934081 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO oslo.messaging._drivers.impl_rabbit [-] [27d9f8ec-de83-4c1d-b952-d59bd3d31c79] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 48114. May 10 14:11:50.048483 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7aee30af-6c55-4d6b-8d77-ac0032b92fab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:50.056778 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7aee30af-6c55-4d6b-8d77-ac0032b92fab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.153181 May 10 14:11:50.057359 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 573/1115] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:11:49 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:51.073636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-5682de4e-f07f-4dda-81c8-48f1dc8e74ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:51.074244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-5682de4e-f07f-4dda-81c8-48f1dc8e74ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:51.080616 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5682de4e-f07f-4dda-81c8-48f1dc8e74ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:51.081059 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5682de4e-f07f-4dda-81c8-48f1dc8e74ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:51.081818 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5682de4e-f07f-4dda-81c8-48f1dc8e74ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:51.082249 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-5682de4e-f07f-4dda-81c8-48f1dc8e74ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:51.215773 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-5682de4e-f07f-4dda-81c8-48f1dc8e74ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:51.223659 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-5682de4e-f07f-4dda-81c8-48f1dc8e74ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.153276 May 10 14:11:51.224260 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 543/1116] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:11:51 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:52.240850 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-a1c901be-b520-4459-9962-a9455e401649 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:52.241369 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-a1c901be-b520-4459-9962-a9455e401649 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:52.247813 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a1c901be-b520-4459-9962-a9455e401649 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:52.248300 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a1c901be-b520-4459-9962-a9455e401649 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:52.249070 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a1c901be-b520-4459-9962-a9455e401649 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:52.249511 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-a1c901be-b520-4459-9962-a9455e401649 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:52.376729 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-a1c901be-b520-4459-9962-a9455e401649 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:52.384658 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-a1c901be-b520-4459-9962-a9455e401649 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.147763 May 10 14:11:52.385236 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 574/1117] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:11:52 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:53.401982 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-2dd3e819-07b2-40c5-b0f1-5d4e5f30eb2a tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:53.402587 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-2dd3e819-07b2-40c5-b0f1-5d4e5f30eb2a tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:53.408899 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2dd3e819-07b2-40c5-b0f1-5d4e5f30eb2a tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:53.409342 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2dd3e819-07b2-40c5-b0f1-5d4e5f30eb2a tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:53.410099 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2dd3e819-07b2-40c5-b0f1-5d4e5f30eb2a tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:53.411156 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-2dd3e819-07b2-40c5-b0f1-5d4e5f30eb2a tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:53.538843 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-2dd3e819-07b2-40c5-b0f1-5d4e5f30eb2a tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:53.546200 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-2dd3e819-07b2-40c5-b0f1-5d4e5f30eb2a tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.148146 May 10 14:11:53.546884 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 544/1118] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:11:53 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:54.562692 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-e5506591-5fd7-40e6-8438-1ac353fb3c1f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:54.563297 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-e5506591-5fd7-40e6-8438-1ac353fb3c1f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:54.570053 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5506591-5fd7-40e6-8438-1ac353fb3c1f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:54.570495 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5506591-5fd7-40e6-8438-1ac353fb3c1f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:54.571258 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5506591-5fd7-40e6-8438-1ac353fb3c1f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:54.571689 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-e5506591-5fd7-40e6-8438-1ac353fb3c1f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:54.696712 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-e5506591-5fd7-40e6-8438-1ac353fb3c1f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:54.703885 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-e5506591-5fd7-40e6-8438-1ac353fb3c1f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.145056 May 10 14:11:54.704496 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 575/1119] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:11:54 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:55.719758 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-6eae38b4-df7f-4016-9ea1-2851c4b943dd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:55.720405 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-6eae38b4-df7f-4016-9ea1-2851c4b943dd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:55.727266 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6eae38b4-df7f-4016-9ea1-2851c4b943dd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:55.727711 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6eae38b4-df7f-4016-9ea1-2851c4b943dd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:55.728506 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6eae38b4-df7f-4016-9ea1-2851c4b943dd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:55.728946 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-6eae38b4-df7f-4016-9ea1-2851c4b943dd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:55.855904 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-6eae38b4-df7f-4016-9ea1-2851c4b943dd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:55.863181 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-6eae38b4-df7f-4016-9ea1-2851c4b943dd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.147293 May 10 14:11:55.863794 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 545/1120] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:11:55 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:56.880136 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-0f587270-398f-4284-88f4-b0a6dbbefbb3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:56.880768 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-0f587270-398f-4284-88f4-b0a6dbbefbb3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:56.887095 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f587270-398f-4284-88f4-b0a6dbbefbb3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:56.887552 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f587270-398f-4284-88f4-b0a6dbbefbb3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:56.888354 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f587270-398f-4284-88f4-b0a6dbbefbb3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:56.888792 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-0f587270-398f-4284-88f4-b0a6dbbefbb3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:57.020952 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-0f587270-398f-4284-88f4-b0a6dbbefbb3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:57.028262 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-0f587270-398f-4284-88f4-b0a6dbbefbb3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.152021 May 10 14:11:57.028840 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 576/1121] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:11:56 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:58.045753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-1c86a8ca-4981-4a04-a35c-51bf4829f604 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:58.046364 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-1c86a8ca-4981-4a04-a35c-51bf4829f604 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:58.052638 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1c86a8ca-4981-4a04-a35c-51bf4829f604 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:58.053259 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1c86a8ca-4981-4a04-a35c-51bf4829f604 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:58.054029 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1c86a8ca-4981-4a04-a35c-51bf4829f604 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:58.054642 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-1c86a8ca-4981-4a04-a35c-51bf4829f604 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:58.186147 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-1c86a8ca-4981-4a04-a35c-51bf4829f604 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:58.193990 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-1c86a8ca-4981-4a04-a35c-51bf4829f604 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.152045 May 10 14:11:58.194558 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 546/1122] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:11:58 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:59.210872 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ad84163b-e681-4f45-a1d1-c2e75f1c3fb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:59.211520 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ad84163b-e681-4f45-a1d1-c2e75f1c3fb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:59.218002 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ad84163b-e681-4f45-a1d1-c2e75f1c3fb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:59.218454 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ad84163b-e681-4f45-a1d1-c2e75f1c3fb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:59.219225 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ad84163b-e681-4f45-a1d1-c2e75f1c3fb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:59.219666 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ad84163b-e681-4f45-a1d1-c2e75f1c3fb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:59.348644 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ad84163b-e681-4f45-a1d1-c2e75f1c3fb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:59.355957 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ad84163b-e681-4f45-a1d1-c2e75f1c3fb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.149013 May 10 14:11:59.356573 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 577/1123] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:11:59 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:00.373306 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bf7f224f-57af-4e67-a347-694dee1788a4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:00.373909 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bf7f224f-57af-4e67-a347-694dee1788a4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:00.380726 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf7f224f-57af-4e67-a347-694dee1788a4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:00.381172 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf7f224f-57af-4e67-a347-694dee1788a4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:00.381945 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf7f224f-57af-4e67-a347-694dee1788a4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:00.382377 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf7f224f-57af-4e67-a347-694dee1788a4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:00.509238 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-bf7f224f-57af-4e67-a347-694dee1788a4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:00.516379 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bf7f224f-57af-4e67-a347-694dee1788a4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1567 microversion: 2.1 time: 0.146872 May 10 14:12:00.517184 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 547/1124] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:00 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:00.533712 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-4f9ee876-1981-4d8a-ab25-864fdb9c1fa3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:12:00.534302 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-4f9ee876-1981-4d8a-ab25-864fdb9c1fa3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:00.540535 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4f9ee876-1981-4d8a-ab25-864fdb9c1fa3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:00.540996 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4f9ee876-1981-4d8a-ab25-864fdb9c1fa3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:00.541764 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4f9ee876-1981-4d8a-ab25-864fdb9c1fa3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:00.542204 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-4f9ee876-1981-4d8a-ab25-864fdb9c1fa3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:00.615293 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-4f9ee876-1981-4d8a-ab25-864fdb9c1fa3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "POST /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9/action" status: 202 len: 0 microversion: 2.1 time: 0.085410 May 10 14:12:00.615921 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 578/1125] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 14:12:00 2022] POST /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:12:00.630922 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0d2b45d6-a0f0-4985-8271-e15e9044ff9f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:00.631536 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0d2b45d6-a0f0-4985-8271-e15e9044ff9f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:00.638367 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d2b45d6-a0f0-4985-8271-e15e9044ff9f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:00.638753 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d2b45d6-a0f0-4985-8271-e15e9044ff9f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:00.639536 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d2b45d6-a0f0-4985-8271-e15e9044ff9f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:00.640278 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0d2b45d6-a0f0-4985-8271-e15e9044ff9f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:00.777320 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0d2b45d6-a0f0-4985-8271-e15e9044ff9f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:00.785235 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0d2b45d6-a0f0-4985-8271-e15e9044ff9f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1515 microversion: 2.1 time: 0.158756 May 10 14:12:00.785854 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 548/1126] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:00 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:01.802984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-24c4dcf7-3293-4045-9a6c-bff07bc1d01f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:01.803809 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-24c4dcf7-3293-4045-9a6c-bff07bc1d01f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:01.809941 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-24c4dcf7-3293-4045-9a6c-bff07bc1d01f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:01.810392 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-24c4dcf7-3293-4045-9a6c-bff07bc1d01f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:01.811163 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-24c4dcf7-3293-4045-9a6c-bff07bc1d01f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:01.811601 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-24c4dcf7-3293-4045-9a6c-bff07bc1d01f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:01.944457 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-24c4dcf7-3293-4045-9a6c-bff07bc1d01f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:01.951881 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-24c4dcf7-3293-4045-9a6c-bff07bc1d01f tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1517 microversion: 2.1 time: 0.153365 May 10 14:12:01.952489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 579/1127] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:01 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:02.969764 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-de3f797e-e7e9-4fad-9bb1-38d4f57208fd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:02.970380 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-de3f797e-e7e9-4fad-9bb1-38d4f57208fd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:02.976722 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-de3f797e-e7e9-4fad-9bb1-38d4f57208fd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:02.977162 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-de3f797e-e7e9-4fad-9bb1-38d4f57208fd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:02.977940 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-de3f797e-e7e9-4fad-9bb1-38d4f57208fd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:02.978417 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-de3f797e-e7e9-4fad-9bb1-38d4f57208fd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:03.110737 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-de3f797e-e7e9-4fad-9bb1-38d4f57208fd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:03.118553 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-de3f797e-e7e9-4fad-9bb1-38d4f57208fd tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1573 microversion: 2.1 time: 0.152673 May 10 14:12:03.119124 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 549/1128] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:02 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:03.418214 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-cef537e2-4b86-4b93-ba04-519e5be0e8e8 req-7a2c64c2-770e-474b-a9c8-df0af65b87ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c8053d-f1c3-442e-9fbe-d47ecc4683a9", "name": "network-vif-unplugged", "status": "completed", "tag": "ebadb043-e9de-4649-a139-09dacac9d1d9"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:12:03.433041 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-cef537e2-4b86-4b93-ba04-519e5be0e8e8 req-7a2c64c2-770e-474b-a9c8-df0af65b87ee service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:03.433480 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-cef537e2-4b86-4b93-ba04-519e5be0e8e8 req-7a2c64c2-770e-474b-a9c8-df0af65b87ee service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:03.444584 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-cef537e2-4b86-4b93-ba04-519e5be0e8e8 req-7a2c64c2-770e-474b-a9c8-df0af65b87ee service nova] Creating event network-vif-unplugged:ebadb043-e9de-4649-a139-09dacac9d1d9 for instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 on hv-cinder-84067 May 10 14:12:03.449683 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-cef537e2-4b86-4b93-ba04-519e5be0e8e8 req-7a2c64c2-770e-474b-a9c8-df0af65b87ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111601 May 10 14:12:03.450278 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 580/1129] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:12:04.135798 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-39b0839f-ca0d-41c3-88bf-4ddb15c555c4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:04.136573 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-39b0839f-ca0d-41c3-88bf-4ddb15c555c4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:04.143133 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-39b0839f-ca0d-41c3-88bf-4ddb15c555c4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:04.143586 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-39b0839f-ca0d-41c3-88bf-4ddb15c555c4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:04.144402 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-39b0839f-ca0d-41c3-88bf-4ddb15c555c4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:04.145411 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-39b0839f-ca0d-41c3-88bf-4ddb15c555c4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:04.274862 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-39b0839f-ca0d-41c3-88bf-4ddb15c555c4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:04.282636 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-39b0839f-ca0d-41c3-88bf-4ddb15c555c4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1573 microversion: 2.1 time: 0.150678 May 10 14:12:04.283205 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 550/1130] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:04 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:05.300345 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2e72f1d3-f27e-4160-9507-e4c1e8decfc9 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:05.301052 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2e72f1d3-f27e-4160-9507-e4c1e8decfc9 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:05.307225 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2e72f1d3-f27e-4160-9507-e4c1e8decfc9 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:05.307679 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2e72f1d3-f27e-4160-9507-e4c1e8decfc9 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:05.308476 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2e72f1d3-f27e-4160-9507-e4c1e8decfc9 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:05.308920 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2e72f1d3-f27e-4160-9507-e4c1e8decfc9 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:05.447079 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2e72f1d3-f27e-4160-9507-e4c1e8decfc9 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:05.454500 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2e72f1d3-f27e-4160-9507-e4c1e8decfc9 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1573 microversion: 2.1 time: 0.158862 May 10 14:12:05.455074 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 581/1131] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:05 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:06.472289 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-0e189660-d7f2-420b-9743-1acc3fbb4f12 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:06.482461 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-0e189660-d7f2-420b-9743-1acc3fbb4f12 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:06.482461 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0e189660-d7f2-420b-9743-1acc3fbb4f12 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:06.482461 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0e189660-d7f2-420b-9743-1acc3fbb4f12 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:06.482461 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0e189660-d7f2-420b-9743-1acc3fbb4f12 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:06.482887 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-0e189660-d7f2-420b-9743-1acc3fbb4f12 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:06.613051 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-0e189660-d7f2-420b-9743-1acc3fbb4f12 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:06.620371 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-0e189660-d7f2-420b-9743-1acc3fbb4f12 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1573 microversion: 2.1 time: 0.152076 May 10 14:12:06.620948 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 551/1132] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:06 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:07.637302 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-5156fddc-5606-4557-af42-2f3045ff3d3c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:07.637907 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-5156fddc-5606-4557-af42-2f3045ff3d3c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:07.644484 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5156fddc-5606-4557-af42-2f3045ff3d3c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:07.644933 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5156fddc-5606-4557-af42-2f3045ff3d3c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:07.645720 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5156fddc-5606-4557-af42-2f3045ff3d3c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:07.646149 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-5156fddc-5606-4557-af42-2f3045ff3d3c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:07.772915 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-5156fddc-5606-4557-af42-2f3045ff3d3c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:07.780192 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-5156fddc-5606-4557-af42-2f3045ff3d3c tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1573 microversion: 2.1 time: 0.146713 May 10 14:12:07.780770 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 582/1133] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:07 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1573 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:08.797553 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-7898ab50-439f-4d10-8d0f-9cebe7188c13 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:08.798096 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-7898ab50-439f-4d10-8d0f-9cebe7188c13 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:08.804942 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7898ab50-439f-4d10-8d0f-9cebe7188c13 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:08.805382 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7898ab50-439f-4d10-8d0f-9cebe7188c13 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:08.806167 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7898ab50-439f-4d10-8d0f-9cebe7188c13 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:08.806598 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-7898ab50-439f-4d10-8d0f-9cebe7188c13 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:08.932316 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-7898ab50-439f-4d10-8d0f-9cebe7188c13 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:08.939507 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-7898ab50-439f-4d10-8d0f-9cebe7188c13 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1573 microversion: 2.1 time: 0.145857 May 10 14:12:08.940069 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 552/1134] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:08 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1573 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:09.956934 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-7895183d-d877-4e92-88d8-2907c0aca671 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:09.957533 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-7895183d-d877-4e92-88d8-2907c0aca671 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:09.963781 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7895183d-d877-4e92-88d8-2907c0aca671 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:09.964264 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7895183d-d877-4e92-88d8-2907c0aca671 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:09.965056 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7895183d-d877-4e92-88d8-2907c0aca671 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:09.965489 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-7895183d-d877-4e92-88d8-2907c0aca671 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:10.090290 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-7895183d-d877-4e92-88d8-2907c0aca671 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:10.097572 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-7895183d-d877-4e92-88d8-2907c0aca671 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1573 microversion: 2.1 time: 0.144489 May 10 14:12:10.098662 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 583/1135] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:09 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1573 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:11.114943 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-cf3f72b6-e60f-4b3d-a3a7-fedd64c066f4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:11.115525 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-cf3f72b6-e60f-4b3d-a3a7-fedd64c066f4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:11.121798 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cf3f72b6-e60f-4b3d-a3a7-fedd64c066f4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:11.122244 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cf3f72b6-e60f-4b3d-a3a7-fedd64c066f4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:11.123004 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cf3f72b6-e60f-4b3d-a3a7-fedd64c066f4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:11.123432 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-cf3f72b6-e60f-4b3d-a3a7-fedd64c066f4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:11.253150 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-cf3f72b6-e60f-4b3d-a3a7-fedd64c066f4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:11.260327 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-cf3f72b6-e60f-4b3d-a3a7-fedd64c066f4 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1573 microversion: 2.1 time: 0.149222 May 10 14:12:11.260886 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 553/1136] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:11 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:12.277423 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-ff3f0f8b-0980-4868-960f-a2b8a6548534 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:12.278063 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-ff3f0f8b-0980-4868-960f-a2b8a6548534 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:12.284479 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ff3f0f8b-0980-4868-960f-a2b8a6548534 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:12.284936 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ff3f0f8b-0980-4868-960f-a2b8a6548534 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:12.286201 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ff3f0f8b-0980-4868-960f-a2b8a6548534 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:12.286642 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-ff3f0f8b-0980-4868-960f-a2b8a6548534 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:12.428248 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-ff3f0f8b-0980-4868-960f-a2b8a6548534 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:12.435947 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-ff3f0f8b-0980-4868-960f-a2b8a6548534 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1573 microversion: 2.1 time: 0.162315 May 10 14:12:12.436553 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 584/1137] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:12 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:13.451430 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-61600b3e-9462-4ab3-b3ca-4b33b6480be1 req-663917f4-2dc1-474b-95aa-a5a5c7bcd7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c8053d-f1c3-442e-9fbe-d47ecc4683a9", "name": "network-vif-plugged", "status": "completed", "tag": "ebadb043-e9de-4649-a139-09dacac9d1d9"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:12:13.454835 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-c8697414-5f8c-4268-b714-7d5750a7f798 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:13.455585 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-c8697414-5f8c-4268-b714-7d5750a7f798 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:13.461466 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-61600b3e-9462-4ab3-b3ca-4b33b6480be1 req-663917f4-2dc1-474b-95aa-a5a5c7bcd7ab service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:13.461915 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-61600b3e-9462-4ab3-b3ca-4b33b6480be1 req-663917f4-2dc1-474b-95aa-a5a5c7bcd7ab service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:13.463551 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8697414-5f8c-4268-b714-7d5750a7f798 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:13.465244 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8697414-5f8c-4268-b714-7d5750a7f798 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:13.465244 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8697414-5f8c-4268-b714-7d5750a7f798 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:13.465578 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-c8697414-5f8c-4268-b714-7d5750a7f798 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:13.473747 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-61600b3e-9462-4ab3-b3ca-4b33b6480be1 req-663917f4-2dc1-474b-95aa-a5a5c7bcd7ab service nova] Creating event network-vif-plugged:ebadb043-e9de-4649-a139-09dacac9d1d9 for instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 on hv-cinder-84067 May 10 14:12:13.478834 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-61600b3e-9462-4ab3-b3ca-4b33b6480be1 req-663917f4-2dc1-474b-95aa-a5a5c7bcd7ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031682 May 10 14:12:13.479559 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 554/1138] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:12:13.596530 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-c8697414-5f8c-4268-b714-7d5750a7f798 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:13.605369 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-c8697414-5f8c-4268-b714-7d5750a7f798 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1573 microversion: 2.1 time: 0.155502 May 10 14:12:13.606146 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 585/1139] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:13 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:14.623225 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-c2b25e39-1dae-45da-9a77-0fef23b1bbe3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:14.623919 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-c2b25e39-1dae-45da-9a77-0fef23b1bbe3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:14.630522 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c2b25e39-1dae-45da-9a77-0fef23b1bbe3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:14.630964 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c2b25e39-1dae-45da-9a77-0fef23b1bbe3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:14.631717 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c2b25e39-1dae-45da-9a77-0fef23b1bbe3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:14.632150 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-c2b25e39-1dae-45da-9a77-0fef23b1bbe3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:14.766424 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-c2b25e39-1dae-45da-9a77-0fef23b1bbe3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:14.774752 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-c2b25e39-1dae-45da-9a77-0fef23b1bbe3 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1573 microversion: 2.1 time: 0.156100 May 10 14:12:14.775323 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 555/1140] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:14 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:15.792434 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-92b03572-85fc-4b59-9d95-d2c61b918c4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:15.793015 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-92b03572-85fc-4b59-9d95-d2c61b918c4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:15.799288 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-92b03572-85fc-4b59-9d95-d2c61b918c4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:15.799769 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-92b03572-85fc-4b59-9d95-d2c61b918c4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:15.800562 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-92b03572-85fc-4b59-9d95-d2c61b918c4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:15.801001 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-92b03572-85fc-4b59-9d95-d2c61b918c4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:15.928897 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-92b03572-85fc-4b59-9d95-d2c61b918c4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:15.936127 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-92b03572-85fc-4b59-9d95-d2c61b918c4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1560 microversion: 2.1 time: 0.147635 May 10 14:12:15.936723 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 586/1141] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:12:15 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:13:18.903675 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:13:18.904320 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Tue May 10 14:13:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:13:26.287487 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-bf55574c-dba2-4054-a79e-d25705365cb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:26.288312 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bf55574c-dba2-4054-a79e-d25705365cb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:26.294499 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf55574c-dba2-4054-a79e-d25705365cb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:26.295172 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf55574c-dba2-4054-a79e-d25705365cb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:26.296053 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf55574c-dba2-4054-a79e-d25705365cb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:26.296528 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-bf55574c-dba2-4054-a79e-d25705365cb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:26.324852 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-bf55574c-dba2-4054-a79e-d25705365cb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Going to try to terminate instance {{(pid=117153) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:13:26.417855 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-bf55574c-dba2-4054-a79e-d25705365cb1 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "DELETE /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 204 len: 0 microversion: 2.1 time: 0.142203 May 10 14:13:26.418560 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 556/1142] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 14:13:26 2022] DELETE /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:13:26.424840 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [req-b98f23ac-4133-49c7-b88e-59727f7efe4f req-0d7eb693-ab03-42ae-98f3-691139463190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c8053d-f1c3-442e-9fbe-d47ecc4683a9", "tag": "ebadb043-e9de-4649-a139-09dacac9d1d9"}]} {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:13:26.427190 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-4138f6c6-500b-4e46-ad95-0b40a16434ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:26.427925 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-4138f6c6-500b-4e46-ad95-0b40a16434ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:26.434271 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4138f6c6-500b-4e46-ad95-0b40a16434ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:26.434734 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4138f6c6-500b-4e46-ad95-0b40a16434ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:26.435333 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-b98f23ac-4133-49c7-b88e-59727f7efe4f req-0d7eb693-ab03-42ae-98f3-691139463190 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:26.435537 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4138f6c6-500b-4e46-ad95-0b40a16434ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:26.435781 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [req-b98f23ac-4133-49c7-b88e-59727f7efe4f req-0d7eb693-ab03-42ae-98f3-691139463190 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:26.435998 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-4138f6c6-500b-4e46-ad95-0b40a16434ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:26.447720 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.compute.server_external_events [req-b98f23ac-4133-49c7-b88e-59727f7efe4f req-0d7eb693-ab03-42ae-98f3-691139463190 service nova] Creating event network-changed:ebadb043-e9de-4649-a139-09dacac9d1d9 for instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 on hv-cinder-84067 May 10 14:13:26.453496 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [req-b98f23ac-4133-49c7-b88e-59727f7efe4f req-0d7eb693-ab03-42ae-98f3-691139463190 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175537 May 10 14:13:26.454426 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 587/1143] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:13:26.579294 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.policy [None req-4138f6c6-500b-4e46-ad95-0b40a16434ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117153) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:26.587540 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-4138f6c6-500b-4e46-ad95-0b40a16434ab tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.164500 May 10 14:13:26.588116 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 557/1144] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:13:26 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:13:27.605433 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-2f660b53-ff6b-45ed-9c09-3c58692d5f4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:27.606140 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-2f660b53-ff6b-45ed-9c09-3c58692d5f4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:27.613103 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2f660b53-ff6b-45ed-9c09-3c58692d5f4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:27.613555 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2f660b53-ff6b-45ed-9c09-3c58692d5f4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:27.614321 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2f660b53-ff6b-45ed-9c09-3c58692d5f4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:27.614763 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-2f660b53-ff6b-45ed-9c09-3c58692d5f4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:27.747237 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-2f660b53-ff6b-45ed-9c09-3c58692d5f4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:27.755458 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-2f660b53-ff6b-45ed-9c09-3c58692d5f4d tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1566 microversion: 2.1 time: 0.154212 May 10 14:13:27.756849 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 588/1145] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:13:27 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:13:28.671138 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [req-697207b1-4fb1-4263-b23e-427b0441dc0e req-8959db46-d5bc-4d10-a234-2da6331c5d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c8053d-f1c3-442e-9fbe-d47ecc4683a9", "name": "network-vif-deleted", "tag": "ebadb043-e9de-4649-a139-09dacac9d1d9"}]} {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:13:28.679583 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-697207b1-4fb1-4263-b23e-427b0441dc0e req-8959db46-d5bc-4d10-a234-2da6331c5d51 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:28.680037 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [req-697207b1-4fb1-4263-b23e-427b0441dc0e req-8959db46-d5bc-4d10-a234-2da6331c5d51 service nova] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:28.693939 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.compute.server_external_events [req-697207b1-4fb1-4263-b23e-427b0441dc0e req-8959db46-d5bc-4d10-a234-2da6331c5d51 service nova] Creating event network-vif-deleted:ebadb043-e9de-4649-a139-09dacac9d1d9 for instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 on hv-cinder-84067 May 10 14:13:28.698569 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [req-697207b1-4fb1-4263-b23e-427b0441dc0e req-8959db46-d5bc-4d10-a234-2da6331c5d51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091315 May 10 14:13:28.699205 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 558/1146] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 14:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:13:28.773984 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-cc8c71b5-465a-4a2f-9397-f7c273f0066b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:28.774792 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.compute.api [None req-cc8c71b5-465a-4a2f-9397-f7c273f0066b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117154) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:28.781350 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cc8c71b5-465a-4a2f-9397-f7c273f0066b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:28.781800 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cc8c71b5-465a-4a2f-9397-f7c273f0066b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:28.782568 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cc8c71b5-465a-4a2f-9397-f7c273f0066b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:28.783010 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG oslo_concurrency.lockutils [None req-cc8c71b5-465a-4a2f-9397-f7c273f0066b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:28.843372 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.policy [None req-cc8c71b5-465a-4a2f-9397-f7c273f0066b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb63f41f4b94ac29c82b334773ca9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534e7deeddb4f72b5e068060f617c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117154) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:28.850747 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-cc8c71b5-465a-4a2f-9397-f7c273f0066b tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 200 len: 1218 microversion: 2.1 time: 0.081295 May 10 14:13:28.851317 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 589/1147] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:13:28 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:13:29.868351 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f528dc68-4cf0-45ce-babf-0f6619f28964 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '>' {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:29.869054 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.compute.api [None req-f528dc68-4cf0-45ce-babf-0f6619f28964 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] [instance: 13c8053d-f1c3-442e-9fbe-d47ecc4683a9] Fetching instance by UUID {{(pid=117153) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:29.875192 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f528dc68-4cf0-45ce-babf-0f6619f28964 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:29.875641 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f528dc68-4cf0-45ce-babf-0f6619f28964 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:29.876433 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f528dc68-4cf0-45ce-babf-0f6619f28964 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:29.876873 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG oslo_concurrency.lockutils [None req-f528dc68-4cf0-45ce-babf-0f6619f28964 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Lock "c2f3e911-f54e-4f71-9a2d-820ec19e53f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:29.889538 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.wsgi [None req-f528dc68-4cf0-45ce-babf-0f6619f28964 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] HTTP exception thrown: Instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 could not be found. May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f528dc68-4cf0-45ce-babf-0f6619f28964 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Request method failure captured: May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: request: GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 HTTP/1.1 May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept: application/json May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Accept-Encoding: identity May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Connection: close May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Length: 0 May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Content-Type: application/json May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Host: 10.222.0.49 May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Openstack-System-Scope: None May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: User-Agent: python-urllib3/1.26.9 May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Auth-Token: gAAAAABienH8I9hxuyCXr9L2sYNgZ2qr7ZcOX7KV87qhzFHtUh-v1Ran3sK8fr9DEio1gcEv36KsFj3aOEePRgSs3MuITkdj3vO6PS7qLIdK2X0a0qARdeylaWcaS7UVux2sk4hTW6CUWfEzTrwzjrTu5oji4BxmCOWm2a10fwaqFPuZXS8pI1k May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Id: None May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Domain-Name: None May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Identity-Status: Confirmed May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Is-Admin-Project: True May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Id: default May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Domain-Name: Default May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Id: 5534e7deeddb4f72b5e068060f617c76 May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Project-Name: tempest-TestShelveInstance-1620059251 May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Role: reader,member May 10 14:13:29.891153 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Roles: reader,member May 10 14:13:29.893189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5534e7deeddb4f72b5e068060f617c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5534e7deeddb4f72b5e068060f617c76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5534e7deeddb4f72b5e068060f617c76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5534e7deeddb4f72b5e068060f617c76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] May 10 14:13:29.893189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant: tempest-TestShelveInstance-1620059251 May 10 14:13:29.893189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Id: 5534e7deeddb4f72b5e068060f617c76 May 10 14:13:29.893189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-Tenant-Name: tempest-TestShelveInstance-1620059251 May 10 14:13:29.893189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User: tempest-TestShelveInstance-1620059251-project May 10 14:13:29.893189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Id: default May 10 14:13:29.893189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Domain-Name: Default May 10 14:13:29.893189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Id: eeb63f41f4b94ac29c82b334773ca9f8 May 10 14:13:29.893189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: X-User-Name: tempest-TestShelveInstance-1620059251-project May 10 14:13:29.893189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: method: > May 10 14:13:29.893189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: exception: Instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 could not be found. May 10 14:13:29.893189 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: action_args: {'id': '13c8053d-f1c3-442e-9fbe-d47ecc4683a9'} May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: {{(pid=117153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 could not be found. May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:13:29.894221 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 could not be found. May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 could not be found. May 10 14:13:29.895890 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: ERROR nova.api.openstack.wsgi May 10 14:13:29.897895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: DEBUG nova.api.openstack.wsgi [None req-f528dc68-4cf0-45ce-babf-0f6619f28964 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Returning 404 to user: Instance 13c8053d-f1c3-442e-9fbe-d47ecc4683a9 could not be found. {{(pid=117153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:13:29.897895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO nova.api.openstack.requestlog [None req-f528dc68-4cf0-45ce-babf-0f6619f28964 tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9" status: 404 len: 111 microversion: 2.1 time: 0.028909 May 10 14:13:29.897895 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: [pid: 117153|app: 0|req: 559/1148] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 14:13:29 2022] GET /compute/v2.1/servers/13c8053d-f1c3-442e-9fbe-d47ecc4683a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:13:30.050939 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: DEBUG nova.api.openstack.wsgi [None req-f05e39e8-6c0a-4677-b226-baabf2ea3cbc tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] Calling method '.version_select at 0x7f5f7c271b80>' {{(pid=117154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:30.070654 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO nova.api.openstack.requestlog [None req-f05e39e8-6c0a-4677-b226-baabf2ea3cbc tempest-TestShelveInstance-1620059251 tempest-TestShelveInstance-1620059251-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1970214200" status: 202 len: 0 microversion: 2.1 time: 0.023518 May 10 14:13:30.071555 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: [pid: 117154|app: 0|req: 590/1149] 10.222.0.49 () {58 vars in 1253 bytes} [Tue May 10 14:13:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1970214200 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:15:06.806157 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:15:06.806754 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Tue May 10 14:15:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:15:32.165178 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:15:32.165770 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Tue May 10 14:15:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:16:38.911583 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:16:38.912214 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Tue May 10 14:16:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:17:02.582408 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:17:02.582948 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Tue May 10 14:17:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:18:26.814749 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:18:26.815337 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Tue May 10 14:18:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:18:38.694877 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:18:38.695357 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Tue May 10 14:18:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:18:41.718447 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:18:41.718927 dv-cinder-840678-6-iscsi devstack@n-api.service[117153]: Tue May 10 14:18:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:18:52.172749 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:18:52.173310 dv-cinder-840678-6-iscsi devstack@n-api.service[117154]: Tue May 10 14:18:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!